00000001:02000400:2.0F:1788638279.020076:0:2967:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg334-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1788638287.916906:0:3169:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg334-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1788638288.864240:0:3212:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1331 MB/s 00000001:01000000:1.0:1788638289.114387:0:3212:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 1655 MB/s 00000001:01000000:1.0:1788638289.363823:0:3212:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 10383 MB/s 00000020:02000000:1.0:1788638289.654546:0:3260:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_3_g980e1e2 00000400:02000000:1.0:1788638290.029643:0:3275:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.134@tcp [8/256/0/180] 00008000:02000000:3.0F:1788638292.444776:0:3424:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1788638348.362071:0:5235:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg334-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788638359.294521:0:5823:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788638359.294664:0:5823:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788638359.294913:0:5823:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000061b5d00d 00000080:02000400:1.0:1788638359.294925:0:5823:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788638359.301053:0:5823:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788638359.301072:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788638359.301127:0:5823:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000f48c2b86) 00000020:00000080:1.0:1788638359.301153:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788638359.321083:0:5823:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788638359.321509:0:5823:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788638359.386827:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788638359.386868:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788638359.386888:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788638359.387763:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788638359.388142:0:5823:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788638359.388583:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788638359.388592:0:5823:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788638359.388603:0:5823:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa0b1f1e3b4b2a4d9 00000020:01000004:3.0:1788638359.388611:0:5823:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788638359.388616:0:5823:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788638359.388620:0:5823:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000061b5d00d from MGS 00000020:01000004:3.0:1788638359.388626:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788638359.388645:0:5823:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000005c51c03f) 00000020:00000080:3.0:1788638359.388656:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788638359.388767:0:5823:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000061b5d00d from MGS, refs=2 00080000:01000000:3.0:1788638359.388772:0:5823:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788638359.388776:0:5823:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa0b1f1e3b4b2a4e7 00000100:00100000:3.0:1788638359.388911:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788638359.389053:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788638359.389059:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788638359.391600:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788638359.391616:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788638359.393100:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788638359.393445:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788638359.393452:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788638359.394674:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788638359.394688:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788638359.403318:0:5823:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788638359.403357:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788638359.410578:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638359.410586:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638359.410587:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638359.411646:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638359.411651:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638359.411652:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638359.412447:0:5823:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788638359.416198:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1788638359.662285:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3079 MB/s 00000001:01000000:2.0:1788638359.911874:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3339 MB/s 00000001:01000000:2.0:1788638360.162777:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 591 MB/s 00000001:01000000:2.0:1788638360.418291:0:5823:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 494 MB/s 00010000:00010000:1.0:1788638360.420630:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:2.0:1788638360.438030:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1788638360.474302:0:5823:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788638360.474321:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788638360.474324:0:5823:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788638360.475681:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788638360.475757:0:5823:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788638360.475829:0:5823:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788638360.476050:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788638360.476077:0:5823:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788638360.476542:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788638360.476758:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788638360.476764:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788638360.477598:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788638360.477607:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788638360.478597:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788638360.478607:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788638360.483344:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788638360.483371:0:5823:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.134@tcp' 00000020:01000004:2.0:1788638360.483373:0:5823:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788638360.483421:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.134@tcp (typ=mgc) 00000020:00000080:2.0:1788638360.483442:0:5823:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.134@tcp (00000000e83e3cb5) 00000020:00000080:2.0:1788638360.483458:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788638360.483547:0:5823:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000843a73aa@MGC192.168.203.134@tcp: add connection 192.168.203.134@tcp at head 00010000:00010000:2.0:1788638360.483715:0:5823:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.134@tcp-0 is initialized 00000040:01000000:2.0:1788638360.483723:0:5823:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.134@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788638360.484421:0:5838:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788638360.489349:0:5840:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788638360.489396:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.134@tcp (uuid 69cfc228-c5da-4a8f-95bc-89dfb88a5f68) 00000020:00000080:2.0:1788638360.489417:0:5823:0:(genops.c:1385:class_connect()) connect: client 69cfc228-c5da-4a8f-95bc-89dfb88a5f68, cookie 0xa0b1f1e3b4b2a4f5 00000100:00080000:2.0:1788638360.489428:0:5823:0:(import.c:545:import_select_connection()) MGC192.168.203.134@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788638360.489434:0:5823:0:(import.c:665:import_select_connection()) MGC192.168.203.134@tcp: import 00000000843a73aa using connection 192.168.203.134@tcp/0@lo 00000100:00100000:2.0:1788638360.489476:0:5823:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000b63c2c28 x1875523183575168/t0(0) o250->MGC192.168.203.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788638360.489501:0:5823:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 69cfc228-c5da-4a8f-95bc-89dfb88a5f68->MGS 00000020:01000004:2.0:1788638360.489522:0:5823:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788638360.489527:0:5823:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788638360.489539:0:5823:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000544e8445) 00000020:00000080:2.0:1788638360.489550:0:5823:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1788638360.490334:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b63c2c28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3290:1875523183575168:0@lo:250: 00000100:00100000:3.0:1788638360.490403:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638360.490477:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183575168 00000100:00100000:3.0:1788638360.490484:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183575168 00000100:00100000:3.0:1788638360.490519:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638360.490526:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2597e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3290:x1875523183575168:12345-0@lo:250: 00010000:00080000:3.0:1788638360.490557:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 69cfc228-c5da-4a8f-95bc-89dfb88a5f68@0@lo t0 exp 0000000000000000 cur 123 last 0 00000020:00000080:3.0:1788638360.490599:0:5834:0:(genops.c:1385:class_connect()) connect: client 69cfc228-c5da-4a8f-95bc-89dfb88a5f68, cookie 0xa0b1f1e3b4b2a503 00000100:00080000:3.0:1788638360.490715:0:5834:0:(import.c:65:import_set_state_nolock()) 00000000948d400a : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788638360.490764:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2597e48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+5:3290:x1875523183575168:12345-0@lo:250: Request processed in 237us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638360.490772:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638360.490830:0:3290:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.134@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788638360.490838:0:3290:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.134@tcp: connect to target with instance 0 00000100:00080000:3.0:1788638360.490845:0:3290:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.134@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788638360.490849:0:3290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788638360.490852:0:3290:0:(import.c:65:import_set_state_nolock()) 00000000843a73aa MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788638360.490855:0:3290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788638360.490861:0:3290:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788638360.490866:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b63c2c28 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3290:1875523183575168:0@lo:250: 00000100:00100000:3.0:1788638360.502034:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788638360.502273:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788638360.502280:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788638360.503433:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788638360.503441:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788638360.510046:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788638360.510061:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788638360.512683:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788638360.512904:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788638360.512911:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788638360.513531:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788638360.513538:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788638360.560377:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788638360.560602:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788638360.560610:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788638360.562134:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788638360.562146:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788638360.562838:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788638360.563423:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788638360.563430:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788638360.564434:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788638360.564443:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788638360.565298:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788638360.565482:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788638360.565488:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788638360.566306:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788638360.566314:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788638360.567171:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788638360.567328:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788638360.567334:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788638360.568033:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788638360.568104:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788638360.598011:0:5823:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788638360.598310:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788638360.598317:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788638360.603214:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788638360.603232:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788638360.604283:0:5823:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788638360.604295:0:5823:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788638360.606187:0:5823:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788638360.606215:0:5823:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788638360.606221:0:5823:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.134@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788638360.606356:0:5823:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.134@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788638360.606389:0:5823:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.134@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788638360.606394:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788638360.606396:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788638360.606397:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788638360.606398:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788638360.606400:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788638360.606401:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788638360.606402:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788638360.606404:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788638360.606405:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788638360.606407:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788638360.606408:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788638360.606410:0:5823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788638360.606412:0:5823:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788638360.606414:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788638360.606416:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788638360.606417:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788638360.606418:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788638360.606419:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788638360.606420:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788638360.606421:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788638360.606422:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788638360.606423:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788638360.606424:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788638360.606425:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788638360.606426:0:5823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788638360.606462:0:5823:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788638360.606478:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003a2338b8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183575296:0@lo:253: 00000100:00100000:3.0:1788638360.606553:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638360.606649:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a6d3b8ae going to sleep for 11 seconds 00000100:00100000:1.0:1788638360.606687:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183575296 00000100:00100000:1.0:1788638360.606694:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183575296 00000100:00100000:1.0:1788638360.606767:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788638360.606777:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000026f3d674 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+5:5823:x1875523183575296:12345-0@lo:253: 20000000:01000000:1.0:1788638360.606976:0:5837:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788638360.606980:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788638360.607420:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788638360.607467:0:5837:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788638360.607771:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788638360.609158:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788638360.609665:0:5837:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788638360.609670:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788638360.609676:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788638360.609679:0:5837:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788638360.609696:0:5837:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788638360.610329:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788638360.610583:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788638360.610596:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788638360.610647:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788638360.610709:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788638360.610745:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788638360.611208:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788638360.611219:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788638360.611268:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788638360.611277:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788638360.611309:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788638360.611316:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788638360.611346:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788638360.611397:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788638360.611433:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788638360.611439:0:5837:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788638360.611452:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788638360.611702:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788638360.611711:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788638360.611743:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788638360.611770:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788638360.611988:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788638360.612001:0:5837:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788638360.612151:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788638360.612160:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788638360.612231:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788638360.612269:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788638360.612300:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788638360.612311:0:5837:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788638360.612394:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788638360.612403:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788638360.612450:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788638360.612483:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788638360.612651:0:5837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788638360.612696:0:5837:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788638360.612706:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788638360.621235:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1788638360.621677:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1788638360.621713:0:5837:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.134@tcp for mdt 20000000:01000000:0.0:1788638360.621716:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.134@tcp (null) (null) (null) 00000040:00080000:0.0:1788638360.621769:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1788638360.621777:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788638360.622113:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788638360.622133:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.134@tcp (null) (null) 00000040:00080000:1.0:1788638360.622204:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788638360.622219:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788638360.622251:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788638360.622283:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788638360.622363:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788638360.622367:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788638360.622370:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788638360.622383:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788638360.622385:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788638360.622418:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788638360.622421:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788638360.625288:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788638360.625700:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788638360.625751:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788638360.625827:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1788638360.625840:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788638360.625843:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788638360.626255:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1788638360.626453:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788638360.626487:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1788638360.626538:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 00000020:00000080:1.0:1788638360.626550:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788638360.626552:0:5837:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1788638360.626557:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788638360.626571:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788638360.626577:0:5837:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788638360.626583:0:5837:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1788638360.629034:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1788638360.631752:0:5837:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788638360.640974:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1788638360.641043:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1788638360.641125:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1788638360.641147:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788638360.641168:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000004c6179cd/0xa0b1f1e3b4b2a50a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638360.641186:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004c6179cd/0xa0b1f1e3b4b2a50a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638360.641197:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004c6179cd/0xa0b1f1e3b4b2a50a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638360.641203:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000004c6179cd/0xa0b1f1e3b4b2a50a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638360.641221:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000004c6179cd/0xa0b1f1e3b4b2a50a lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638360.641228:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000004c6179cd/0xa0b1f1e3b4b2a50a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638360.641233:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004c6179cd already unused, calling callback (00000000136e0be3) 00010000:00010000:2.0:1788638360.641237:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000004c6179cd/0xa0b1f1e3b4b2a50a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638360.641244:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000004c6179cd/0xa0b1f1e3b4b2a50a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638360.641256:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000004c6179cd/0xa0b1f1e3b4b2a50a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638360.641263:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000004c6179cd/0xa0b1f1e3b4b2a50a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638360.641269:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004c6179cd/0xa0b1f1e3b4b2a50a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788638360.641287:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788638360.814161:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000026f3d674 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+5:5823:x1875523183575296:12345-0@lo:253: Request processed in 207377us (207599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638360.814179:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788638360.814259:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003a2338b8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183575296:0@lo:253: 10000000:01000000:2.0:1788638360.814276:0:5823:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788638360.814280:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788638360.814282:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788638360.814283:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788638360.814284:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788638360.814285:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788638360.814301:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788638360.814302:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788638360.814304:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788638360.814305:0:5823:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788638360.814307:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788638360.814308:0:5823:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788638360.814327:0:5823:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000061b5d00d from lustre-MDT0000 10000000:01000000:2.0:1788638360.814369:0:5823:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788638360.814372:0:5823:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788638360.814376:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c738375b380 10000000:01000000:2.0:1788638360.814381:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788638360.814390:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c738375b380 from 1 10000000:01000000:2.0:1788638360.814393:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788638360.814429:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: 000000004c6179cd/0xa0b1f1e3b4b2a511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638360.814440:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: 000000004c6179cd/0xa0b1f1e3b4b2a511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638360.814448:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: 000000004c6179cd/0xa0b1f1e3b4b2a511 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638360.814465:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007101fc5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183575424:0@lo:101: 00000100:00100000:2.0:1788638360.814597:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638360.814683:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1440e37 going to sleep for 11 seconds 00000100:00100000:3.0:1788638360.814752:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183575424 00000100:00100000:3.0:1788638360.814758:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183575424 00000100:00100000:3.0:1788638360.814907:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638360.814917:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003812d1bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+5:5823:x1875523183575424:12345-0@lo:101: 00010000:00010000:3.0:1788638360.814932:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638360.814948:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006159fd04/0xa0b1f1e3b4b2a518 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a511 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638360.814971:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006159fd04/0xa0b1f1e3b4b2a518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a511 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638360.814981:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006159fd04/0xa0b1f1e3b4b2a518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a511 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638360.815002:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006159fd04, rc 0) 00000100:00100000:3.0:1788638360.815047:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003812d1bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+6:5823:x1875523183575424:12345-0@lo:101: Request processed in 132us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638360.815054:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788638360.815113:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007101fc5e pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183575424:0@lo:101: 00010000:00010000:0.0:1788638360.815126:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: 000000004c6179cd/0xa0b1f1e3b4b2a511 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a518 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638360.815134:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: 000000004c6179cd/0xa0b1f1e3b4b2a511 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a518 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638360.815191:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b13a3c5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183575552:0@lo:501: 00000100:00100000:0.0:1788638360.815221:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638360.815342:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000000efed8ee going to sleep for 11 seconds 00000100:00100000:2.0:1788638360.815406:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183575552 00000100:00100000:2.0:1788638360.815411:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183575552 00000100:00100000:2.0:1788638360.815433:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788638360.815438:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009bf33f74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+6:5823:x1875523183575552:12345-0@lo:501: 00000100:00100000:2.0:1788638360.815696:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009bf33f74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+6:5823:x1875523183575552:12345-0@lo:501: Request processed in 258us (474us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788638360.815703:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788638360.815771:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b13a3c5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183575552:0@lo:501: 10000000:01000000:0.0:1788638360.815806:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788638360.815823:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: 000000004c6179cd/0xa0b1f1e3b4b2a511 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a518 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638360.815831:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: 000000004c6179cd/0xa0b1f1e3b4b2a511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a518 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638360.815839:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c7387a11800 10000000:01000000:0.0:1788638360.815843:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788638360.815846:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c7387a11800 10000000:01000000:0.0:1788638360.815848:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788638360.815851:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c7387a11800 from 1 10000000:01000000:0.0:1788638360.815853:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788638360.815869:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: 00000000df7bf52a/0xa0b1f1e3b4b2a51f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638360.815876:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: 00000000df7bf52a/0xa0b1f1e3b4b2a51f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638360.815884:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: 00000000df7bf52a/0xa0b1f1e3b4b2a51f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638360.815895:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b13a3c5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183575680:0@lo:101: 00000100:00100000:0.0:1788638360.815920:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638360.815934:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000000efed8ee going to sleep for 11 seconds 00000100:00100000:0.0:1788638360.815952:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183575680 00000100:00100000:0.0:1788638360.815956:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183575680 00000100:00100000:0.0:1788638360.815984:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788638360.815993:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007720edfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+6:5823:x1875523183575680:12345-0@lo:101: 00010000:00010000:0.0:1788638360.816001:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638360.816010:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dc754013/0xa0b1f1e3b4b2a526 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a51f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638360.816023:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dc754013/0xa0b1f1e3b4b2a526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a51f expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638360.816030:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dc754013/0xa0b1f1e3b4b2a526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a51f expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638360.816036:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dc754013, rc 0) 00000100:00100000:0.0:1788638360.816064:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007720edfc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+7:5823:x1875523183575680:12345-0@lo:101: Request processed in 71us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638360.816069:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788638360.816099:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b13a3c5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183575680:0@lo:101: 00010000:00010000:0.0:1788638360.816108:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: 00000000df7bf52a/0xa0b1f1e3b4b2a51f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a526 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638360.816115:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: 00000000df7bf52a/0xa0b1f1e3b4b2a51f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a526 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638360.816126:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788638360.816129:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: 00000000df7bf52a/0xa0b1f1e3b4b2a51f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a526 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638360.816133:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: 00000000df7bf52a/0xa0b1f1e3b4b2a51f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a526 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638360.816149:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788638360.816152:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788638360.816156:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c7387a11800 10000000:01000000:0.0:1788638360.816158:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788638360.816160:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788638360.816162:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788638360.816174:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: 0000000012b694cb/0xa0b1f1e3b4b2a52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638360.816180:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: 0000000012b694cb/0xa0b1f1e3b4b2a52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638360.816186:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: 0000000012b694cb/0xa0b1f1e3b4b2a52d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638360.816196:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b13a3c5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183575808:0@lo:101: 00000100:00100000:0.0:1788638360.816221:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638360.816234:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000000efed8ee going to sleep for 11 seconds 00000100:00100000:0.0:1788638360.816246:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183575808 00000100:00100000:0.0:1788638360.816250:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183575808 00000100:00100000:0.0:1788638360.816266:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788638360.816271:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000122a57bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+7:5823:x1875523183575808:12345-0@lo:101: 00010000:00010000:0.0:1788638360.816277:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638360.816284:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000011b23058/0xa0b1f1e3b4b2a534 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a52d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638360.816295:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000011b23058/0xa0b1f1e3b4b2a534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a52d expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638360.816313:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000011b23058/0xa0b1f1e3b4b2a534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a52d expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638360.816319:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000011b23058, rc 0) 00000100:00100000:0.0:1788638360.816344:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000122a57bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+8:5823:x1875523183575808:12345-0@lo:101: Request processed in 74us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638360.816350:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788638360.816378:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b13a3c5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183575808:0@lo:101: 00010000:00010000:0.0:1788638360.816387:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: 0000000012b694cb/0xa0b1f1e3b4b2a52d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a534 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638360.816393:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: 0000000012b694cb/0xa0b1f1e3b4b2a52d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a534 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638360.816424:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b13a3c5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183575936:0@lo:501: 00000100:00100000:0.0:1788638360.816445:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638360.816456:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000000efed8ee going to sleep for 11 seconds 00000100:00100000:0.0:1788638360.816467:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183575936 00000100:00100000:0.0:1788638360.816470:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183575936 00000100:00100000:0.0:1788638360.816485:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788638360.816489:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000082d83040 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+8:5823:x1875523183575936:12345-0@lo:501: 00000100:00100000:0.0:1788638360.816680:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000082d83040 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+9:5823:x1875523183575936:12345-0@lo:501: Request processed in 189us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638360.816687:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788638360.816715:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b13a3c5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183575936:0@lo:501: 00000100:00100000:0.0:1788638360.816748:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b13a3c5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183576064:0@lo:503: 00000100:00100000:0.0:1788638360.816801:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638360.816814:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000000efed8ee going to sleep for 11 seconds 00000100:00100000:0.0:1788638360.816827:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183576064 00000100:00100000:0.0:1788638360.816830:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183576064 00000100:00100000:0.0:1788638360.816846:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788638360.816850:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1ee9bd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+9:5823:x1875523183576064:12345-0@lo:503: 00000100:00100000:0.0:1788638360.816988:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1ee9bd5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+9:5823:x1875523183576064:12345-0@lo:503: Request processed in 137us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638360.816994:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788638360.817026:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b13a3c5c pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183576064:0@lo:503: 00000100:00100000:2.0:1788638360.817430:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004df334a9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5865:1875523183576192:0@lo:502: 00000100:00100000:2.0:1788638360.817466:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638360.817495:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b1440e37 going to sleep for 11 seconds 00000100:00100000:0.0:1788638360.817540:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183576192 00000100:00100000:0.0:1788638360.817544:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183576192 00000100:00100000:0.0:1788638360.817571:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788638360.817577:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eb395102 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+9:5865:x1875523183576192:12345-0@lo:502: 00000100:00100000:0.0:1788638360.817711:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eb395102 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+9:5865:x1875523183576192:12345-0@lo:502: Request processed in 135us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638360.817718:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788638360.817828:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004df334a9 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5865:1875523183576192:0@lo:502: 00000020:01000000:2.0:1788638360.817848:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788638360.817859:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638360.817862:0:5865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788638360.817866:0:5865:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1788638360.817869:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788638360.817883:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000005a3c8189) 00000020:00000080:2.0:1788638360.817898:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1788638360.817903:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788638360.817970:0:5865:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788638360.817976:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa0b1f1e3b4b2a542 00000020:00000080:2.0:1788638360.818188:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788638360.818192:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788638360.818195:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638360.818197:0:5865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1788638360.818199:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788638360.818202:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638360.818203:0:5865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1788638360.818206:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788638360.818213:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000af6f3850) 00000020:00000080:2.0:1788638360.818222:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1788638360.818225:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788638360.818227:0:5865:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1788638360.818230:0:5865:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1788638360.818235:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788638360.818278:0:5865:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000061b5d00d from lustre-MDT0000, refs=3 00000020:00000080:2.0:1788638360.818296:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000004003160e) 00000020:00000080:2.0:1788638360.818312:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1788638360.818378:0:5865:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788638360.818384:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa0b1f1e3b4b2a557 00000020:00000080:2.0:1788638360.818500:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1788638360.818507:0:5865:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788638360.818511:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa0b1f1e3b4b2a55e 00080000:01000000:2.0:1788638360.818516:0:5865:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788638360.818595:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa0b1f1e3b4b2a565 00080000:10000000:2.0:1788638360.819146:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1788638360.819347:0:5865:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788638360.827342:0:5865:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1788638360.892610:0:5865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788638360.893342:0:5865:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788638360.895422:0:5865:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788638360.895774:0:5865:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788638360.922618:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000098439b19) 00000020:00000080:0.0:1788638360.922644:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788638360.922769:0:5865:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788638360.922777:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa0b1f1e3b4b2a573 00000020:00000080:0.0:1788638360.923253:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788638360.926049:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788638360.953510:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788638360.982451:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788638361.013410:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788638361.052364:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1788638361.076044:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1788638361.101008:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa0b1f1e3b4b2a57a 00000020:00000080:0.0:1788638361.103297:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788638361.103312:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638361.103322:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638361.103325:0:5865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788638361.103334:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788638361.103338:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638361.103339:0:5865:0:(obd_config.c:1563:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788638361.103342:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788638361.103344:0:5865:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788638361.103349:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638361.103351:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638361.103352:0:5865:0:(obd_config.c:1563:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788638361.103354:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788638361.103359:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638361.103360:0:5865:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788638361.103364:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788638361.103408:0:5865:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788638361.103475:0:5865:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b13a3c5c pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5865:1875523183576320:0@lo:502: 00000100:00100000:0.0:1788638361.103580:0:5865:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638361.103683:0:5865:0:(client.c:2716:ptlrpc_set_wait()) set 00000000686a26ed going to sleep for 11 seconds 00000100:00100000:1.0:1788638361.103909:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183576320 00000100:00100000:1.0:1788638361.103918:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183576320 00000100:00100000:1.0:1788638361.103958:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788638361.103967:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000404f0937 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+9:5865:x1875523183576320:12345-0@lo:502: 00000100:00100000:1.0:1788638361.104571:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000404f0937 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+9:5865:x1875523183576320:12345-0@lo:502: Request processed in 604us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638361.104580:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788638361.104673:0:5865:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b13a3c5c pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5865:1875523183576320:0@lo:502: 00000020:01000000:0.0:1788638361.104700:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638361.104705:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638361.104707:0:5865:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1788638361.104711:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788638361.105444:0:5823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788638361.105464:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788638361.105483:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: 0000000012b694cb/0xa0b1f1e3b4b2a52d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a534 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.105496:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: 0000000012b694cb/0xa0b1f1e3b4b2a52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a534 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638361.105505:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7387a11800 from 1 10000000:01000000:1.0:1788638361.105508:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788638361.105552:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: 00000000903fba3d/0xa0b1f1e3b4b2a581 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.105574:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: 00000000903fba3d/0xa0b1f1e3b4b2a581 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.105583:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: 00000000903fba3d/0xa0b1f1e3b4b2a581 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638361.105600:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ba4160ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183576448:0@lo:101: 00000100:00100000:1.0:1788638361.105642:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638361.105679:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 000000000570c138 going to sleep for 11 seconds 00000100:00100000:0.0:1788638361.105863:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183576448 00000100:00100000:0.0:1788638361.105871:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183576448 00000100:00100000:0.0:1788638361.105908:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788638361.105916:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008811d33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+9:5823:x1875523183576448:12345-0@lo:101: 00010000:00010000:0.0:1788638361.105926:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638361.105947:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000081e0f64a/0xa0b1f1e3b4b2a588 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a581 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638361.105968:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000081e0f64a/0xa0b1f1e3b4b2a588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a581 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638361.105977:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000081e0f64a/0xa0b1f1e3b4b2a588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a581 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638361.105985:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000081e0f64a, rc 0) 00000100:00100000:0.0:1788638361.106029:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008811d33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+10:5823:x1875523183576448:12345-0@lo:101: Request processed in 114us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638361.106036:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788638361.106207:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ba4160ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183576448:0@lo:101: 00010000:00010000:2.0:1788638361.106220:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: 00000000903fba3d/0xa0b1f1e3b4b2a581 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a588 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638361.106228:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: 00000000903fba3d/0xa0b1f1e3b4b2a581 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a588 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638361.106809:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004df334a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183576576:0@lo:256: 00000100:00100000:2.0:1788638361.106864:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638361.106895:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000be129b69 going to sleep for 11 seconds 00000100:00100000:1.0:1788638361.107010:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183576576 00000100:00100000:1.0:1788638361.107016:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183576576 00000100:00100000:1.0:1788638361.107092:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788638361.107100:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007cacb46b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+10:5823:x1875523183576576:12345-0@lo:256: 20000000:01000000:1.0:1788638361.107123:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788638361.107129:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788638361.107198:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007cacb46b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+10:5823:x1875523183576576:12345-0@lo:256: Request processed in 99us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638361.107205:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788638361.107267:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004df334a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183576576:0@lo:256: 10000000:01000000:2.0:1788638361.107849:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788638361.107864:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: 00000000903fba3d/0xa0b1f1e3b4b2a581 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a588 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638361.107872:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: 00000000903fba3d/0xa0b1f1e3b4b2a581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a588 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638361.107889:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7387a11800 from 1 10000000:01000000:2.0:1788638361.107892:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788638361.107913:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: 00000000404a044d/0xa0b1f1e3b4b2a58f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638361.107919:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: 00000000404a044d/0xa0b1f1e3b4b2a58f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638361.107927:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: 00000000404a044d/0xa0b1f1e3b4b2a58f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638361.107940:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004df334a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183576704:0@lo:101: 00000100:00100000:2.0:1788638361.107970:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638361.108301:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000be129b69 going to sleep for 11 seconds 00000100:00100000:3.0:1788638361.108350:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183576704 00000100:00100000:3.0:1788638361.108356:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183576704 00000100:00100000:3.0:1788638361.108385:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788638361.108392:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a320ddb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+10:5823:x1875523183576704:12345-0@lo:101: 00010000:00010000:3.0:1788638361.108401:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638361.108466:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002930698f/0xa0b1f1e3b4b2a596 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a58f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638361.108487:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002930698f/0xa0b1f1e3b4b2a596 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a58f expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638361.108496:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002930698f/0xa0b1f1e3b4b2a596 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a58f expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638361.108503:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002930698f, rc 0) 00000100:00100000:3.0:1788638361.108633:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a320ddb9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:5823:x1875523183576704:12345-0@lo:101: Request processed in 241us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638361.108640:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788638361.108759:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004df334a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183576704:0@lo:101: 00010000:00010000:2.0:1788638361.108770:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: 00000000404a044d/0xa0b1f1e3b4b2a58f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a596 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638361.108778:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: 00000000404a044d/0xa0b1f1e3b4b2a58f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a596 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638361.108928:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004df334a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183576832:0@lo:501: 00000100:00100000:2.0:1788638361.108957:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638361.109017:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000be129b69 going to sleep for 11 seconds 00000100:00100000:3.0:1788638361.109051:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183576832 00000100:00100000:3.0:1788638361.109055:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183576832 00000100:00100000:3.0:1788638361.109121:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788638361.109127:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b310afb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:5823:x1875523183576832:12345-0@lo:501: 00000100:00100000:3.0:1788638361.109972:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b310afb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:5823:x1875523183576832:12345-0@lo:501: Request processed in 844us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638361.109980:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788638361.110056:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004df334a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183576832:0@lo:501: 00000100:00100000:2.0:1788638361.110087:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004df334a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183576960:0@lo:503: 00000100:00100000:2.0:1788638361.110137:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638361.110328:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000be129b69 going to sleep for 11 seconds 00000100:00100000:1.0:1788638361.110401:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183576960 00000100:00100000:1.0:1788638361.110407:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183576960 00000100:00100000:1.0:1788638361.110443:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788638361.110450:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033e2ffce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:5823:x1875523183576960:12345-0@lo:503: 00000040:00080000:1.0:1788638361.110489:0:5834:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788638361.110535:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033e2ffce pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:5823:x1875523183576960:12345-0@lo:503: Request processed in 86us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638361.110542:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788638361.110663:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004df334a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183576960:0@lo:503: 00000040:00080000:2.0:1788638361.111524:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1788638361.111728:0:5823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1788638361.111747:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788638361.111766:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: 00000000404a044d/0xa0b1f1e3b4b2a58f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a596 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.111778:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: 00000000404a044d/0xa0b1f1e3b4b2a58f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a596 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638361.111849:0:5823:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788638361.111852:0:5823:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c7387a11800 10000000:01000000:1.0:1788638361.111855:0:5823:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c7387a11800 10000000:01000000:1.0:1788638361.111860:0:5823:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788638361.111865:0:5823:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7387a11800 from 1 10000000:01000000:1.0:1788638361.111868:0:5823:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788638361.111895:0:5823:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: 00000000a8ce8a1a/0xa0b1f1e3b4b2a59d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.111915:0:5823:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: 00000000a8ce8a1a/0xa0b1f1e3b4b2a59d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.111924:0:5823:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: 00000000a8ce8a1a/0xa0b1f1e3b4b2a59d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638361.111940:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6206f46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183577088:0@lo:101: 00000100:00100000:1.0:1788638361.111987:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638361.112018:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000df404d2c going to sleep for 11 seconds 00000100:00100000:1.0:1788638361.112035:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183577088 00000100:00100000:1.0:1788638361.112040:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183577088 00000100:00100000:1.0:1788638361.112067:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788638361.112074:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c232b1fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:5823:x1875523183577088:12345-0@lo:101: 00010000:00010000:1.0:1788638361.112085:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638361.112098:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000044c36d03/0xa0b1f1e3b4b2a5a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a59d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.112118:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000044c36d03/0xa0b1f1e3b4b2a5a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a59d expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.112128:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000044c36d03/0xa0b1f1e3b4b2a5a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a59d expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.112136:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000044c36d03, rc 0) 00000100:00100000:1.0:1788638361.112169:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c232b1fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:5823:x1875523183577088:12345-0@lo:101: Request processed in 97us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638361.112176:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788638361.112211:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6206f46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183577088:0@lo:101: 00010000:00010000:1.0:1788638361.112230:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: 00000000a8ce8a1a/0xa0b1f1e3b4b2a59d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a5a4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.112238:0:5823:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: 00000000a8ce8a1a/0xa0b1f1e3b4b2a59d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a5a4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638361.112282:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6206f46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183577216:0@lo:501: 00000100:00100000:1.0:1788638361.112305:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638361.112317:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000df404d2c going to sleep for 11 seconds 00000100:00100000:1.0:1788638361.112329:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183577216 00000100:00100000:1.0:1788638361.112332:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183577216 00000100:00100000:1.0:1788638361.112347:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788638361.112352:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f2ffa75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:5823:x1875523183577216:12345-0@lo:501: 00000100:00100000:1.0:1788638361.112622:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f2ffa75 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:5823:x1875523183577216:12345-0@lo:501: Request processed in 269us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638361.112629:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788638361.112659:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6206f46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183577216:0@lo:501: 00000100:00100000:1.0:1788638361.112682:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6206f46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183577344:0@lo:503: 00000100:00100000:1.0:1788638361.112716:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638361.112729:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 00000000df404d2c going to sleep for 11 seconds 00000100:00100000:1.0:1788638361.112742:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183577344 00000100:00100000:1.0:1788638361.112745:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183577344 00000100:00100000:1.0:1788638361.112762:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788638361.112767:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003e8991c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:5823:x1875523183577344:12345-0@lo:503: 00000100:00100000:1.0:1788638361.113082:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003e8991c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:5823:x1875523183577344:12345-0@lo:503: Request processed in 315us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638361.113089:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788638361.113135:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6206f46 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183577344:0@lo:503: 00000100:00100000:1.0:1788638361.113293:0:5870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6206f46 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5870:1875523183577472:0@lo:502: 00000100:00100000:1.0:1788638361.113325:0:5870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638361.113343:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183577472 00000100:00100000:1.0:1788638361.113346:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183577472 00000100:00100000:1.0:1788638361.113364:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788638361.113369:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d190fe56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:5870:x1875523183577472:12345-0@lo:502: 00000100:00100000:1.0:1788638361.113527:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d190fe56 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:5870:x1875523183577472:12345-0@lo:502: Request processed in 157us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638361.113533:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788638361.113571:0:5870:0:(client.c:2716:ptlrpc_set_wait()) set 0000000036db2941 going to sleep for 11 seconds 00000100:00100000:1.0:1788638361.113583:0:5870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6206f46 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5870:1875523183577472:0@lo:502: 00000020:01000004:1.0:1788638361.113632:0:5870:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788638361.113647:0:5870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000fe489f84) 00000020:00000080:1.0:1788638361.113662:0:5870:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788638361.113740:0:5870:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000061b5d00d from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788638361.113744:0:5870:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000061b5d00d from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788638361.113748:0:5870:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000061b5d00d 4 00010000:00080000:1.0:1788638361.113774:0:5870:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000809f0262@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.134@tcp at head 00010000:00010000:1.0:1788638361.116093:0:5870:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788638361.116328:0:5870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788638361.116367:0:5870:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788638361.116378:0:5870:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa0b1f1e3b4b2a5b2 00000100:00080000:1.0:1788638361.116388:0:5870:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788638361.116393:0:5870:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000809f0262 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:1.0:1788638361.116553:0:5870:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c6206f46 x1875523183577600/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788638361.116628:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c6206f46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875523183577600:0@lo:38: 00000100:00100000:3.0:1788638361.116694:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638361.116777:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183577600 00000100:00100000:0.0:1788638361.116808:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183577600 00000100:00100000:0.0:1788638361.116837:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788638361.116843:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028981793 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1875523183577600:12345-0@lo:38: 00000100:00080000:1.0:1788638361.118523:0:5870:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788638361.118866:0:5870:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000027468ec3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5870:1875523183577728:0@lo:502: 00000100:00100000:1.0:1788638361.118934:0:5870:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638361.118964:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183577728 00000100:00100000:1.0:1788638361.118969:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183577728 00000100:00100000:1.0:1788638361.119004:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788638361.119011:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091e0a8a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:5870:x1875523183577728:12345-0@lo:502: 00000100:00100000:1.0:1788638361.119238:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091e0a8a1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:5870:x1875523183577728:12345-0@lo:502: Request processed in 227us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638361.119245:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788638361.119290:0:5870:0:(client.c:2716:ptlrpc_set_wait()) set 000000005e433824 going to sleep for 11 seconds 00000100:00100000:1.0:1788638361.119308:0:5870:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000027468ec3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5870:1875523183577728:0@lo:502: 00000040:00080000:1.0:1788638361.119331:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788638361.119383:0:5823:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788638361.119403:0:5823:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788638361.119414:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: 00000000a8ce8a1a/0xa0b1f1e3b4b2a59d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a5a4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.119435:0:5823:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: 00000000a8ce8a1a/0xa0b1f1e3b4b2a59d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a5a4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788638361.119474:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788638361.119476:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788638361.119478:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638361.119479:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638361.119480:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638361.119481:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638361.119483:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788638361.119488:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788638361.119490:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788638361.119491:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788638361.119492:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638361.119493:0:5823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788638361.119497:0:5823:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788638361.119499:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788638361.119500:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788638361.119501:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638361.119502:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638361.119503:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638361.119504:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638361.119505:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788638361.119506:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788638361.119507:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788638361.119507:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788638361.119508:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638361.119509:0:5823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788638361.119520:0:5823:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788638361.119527:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000027468ec3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183577856:0@lo:253: 00000100:00100000:1.0:1788638361.119566:0:5823:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638361.119583:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set 0000000053f27283 going to sleep for 11 seconds 00000100:00100000:0.0:1788638361.119964:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028981793 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1875523183577600:12345-0@lo:38: Request processed in 3118us (3269us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788638361.119973:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788638361.119994:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183577856 00000100:00100000:0.0:1788638361.119998:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183577856 00000100:00100000:0.0:1788638361.120029:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788638361.120035:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e976f07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:5823:x1875523183577856:12345-0@lo:253: 20000000:01000000:0.0:1788638361.120055:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788638361.120068:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788638361.124915:0:3290:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788638361.124926:0:3290:0:(import.c:65:import_set_state_nolock()) 00000000809f0262 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788638361.124934:0:3290:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788638361.124937:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c6206f46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875523183577600:0@lo:38: 20000000:01000000:2.0:1788638361.144661:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788638361.144679:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788638361.144762:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788638361.144768:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788638361.144821:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008fd36eca/0xa0b1f1e3b4b2a5b9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.144840:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000081e0f64a/0xa0b1f1e3b4b2a588 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a581 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.144846:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008fd36eca/0xa0b1f1e3b4b2a5b9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.144886:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000081e0f64a/0xa0b1f1e3b4b2a588 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a581 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.144919:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000081e0f64a/0xa0b1f1e3b4b2a588 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a581 expref: 12 pid: 5837 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638361.144934:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074779fe5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875523183577984:0@lo:104: 00000100:00100000:1.0:1788638361.144997:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638361.145048:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set 000000008e289eb1 going to sleep for 11 seconds 00000100:00100000:1.0:1788638361.145076:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183577984 00000100:00100000:1.0:1788638361.145084:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183577984 00000100:00100000:1.0:1788638361.145120:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788638361.145127:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b1a573e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:5858:x1875523183577984:12345-0@lo:104: 00010000:00010000:1.0:1788638361.145138:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: 00000000903fba3d/0xa0b1f1e3b4b2a581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a588 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.145179:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788638361.145184:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b1a573e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:5858:x1875523183577984:12345-0@lo:104: Request processed in 58us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638361.145190:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788638361.145211:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638361.145215:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: 00000000903fba3d/0xa0b1f1e3b4b2a581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a588 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.145222:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000903fba3d already unused, calling callback (000000006409b6c2) 10000000:00010000:1.0:1788638361.145225:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: 00000000903fba3d/0xa0b1f1e3b4b2a581 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a588 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.145233:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: 00000000903fba3d/0xa0b1f1e3b4b2a581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a588 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638361.145249:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: 00000000903fba3d/0xa0b1f1e3b4b2a581 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a588 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638361.145254:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788638361.145279:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: 00000000903fba3d/0xa0b1f1e3b4b2a581 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a588 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.145285:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788638361.145298:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: 00000000903fba3d/0xa0b1f1e3b4b2a581 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a588 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.145305:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: 00000000903fba3d/0xa0b1f1e3b4b2a581 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a588 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.145319:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638361.145320:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638361.145322:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638361.145378:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e2114aaa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3292:1875523183578112:0@lo:103: 00000100:00100000:1.0:1788638361.145402:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638361.145469:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183578112 00000100:00100000:1.0:1788638361.145473:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183578112 00010000:00010000:1.0:1788638361.145487:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000081e0f64a/0xa0b1f1e3b4b2a588 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a581 expref: 13 pid: 5837 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638361.145506:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788638361.145510:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8cbd405 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:3292:x1875523183578112:12345-0@lo:103: 00010000:00010000:1.0:1788638361.145587:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638361.145592:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000081e0f64a/0xa0b1f1e3b4b2a588 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a581 expref: 13 pid: 5837 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.145607:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000081e0f64a/0xa0b1f1e3b4b2a588 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a581 expref: 13 pid: 5837 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.145621:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008fd36eca/0xa0b1f1e3b4b2a5b9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.145628:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008fd36eca/0xa0b1f1e3b4b2a5b9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788638361.145639:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000872822s 00010000:00010000:1.0:1788638361.145642:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008fd36eca/0xa0b1f1e3b4b2a5b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.145648:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008fd36eca/0xa0b1f1e3b4b2a5b9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.145655:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008fd36eca/0xa0b1f1e3b4b2a5b9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.145661:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008fd36eca/0xa0b1f1e3b4b2a5b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.145665:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008fd36eca already unused, calling callback (00000000136e0be3) 00010000:00010000:1.0:1788638361.145668:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008fd36eca/0xa0b1f1e3b4b2a5b9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.145674:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008fd36eca/0xa0b1f1e3b4b2a5b9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.145681:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008fd36eca/0xa0b1f1e3b4b2a5b9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.145698:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638361.145725:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8cbd405 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:3292:x1875523183578112:12345-0@lo:103: Request processed in 215us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638361.145732:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788638361.145764:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000081e0f64a/0xa0b1f1e3b4b2a588 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a581 expref: 12 pid: 5837 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638361.145774:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074779fe5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875523183577984:0@lo:104: 00010000:00010000:1.0:1788638361.145811:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008fd36eca/0xa0b1f1e3b4b2a5b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.145819:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008fd36eca/0xa0b1f1e3b4b2a5b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.145825:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008fd36eca/0xa0b1f1e3b4b2a5b9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638361.145830:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008fd36eca/0xa0b1f1e3b4b2a5b9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638361.145852:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e2114aaa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3292:1875523183578112:0@lo:103: 00000100:00100000:1.0:1788638361.152851:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e976f07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:5823:x1875523183577856:12345-0@lo:253: Request processed in 32810us (33288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638361.152867:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788638361.152954:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000027468ec3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5823:1875523183577856:0@lo:253: 10000000:01000000:0.0:1788638361.152970:0:5823:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788638361.152973:0:5823:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788638361.152988:0:5823:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788638361.152989:0:5823:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788638361.152991:0:5823:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788638361.152992:0:5823:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788638361.152994:0:5823:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788638361.152995:0:5823:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788638361.152997:0:5823:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788638361.152999:0:5823:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788638361.153000:0:5823:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788638361.153002:0:5823:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788638361.153004:0:5823:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788638361.153019:0:5823:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788638361.157167:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788638361.157509:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788638361.157759:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788638361.157979:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788638361.158144:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788638361.158276:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788638361.159064:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788638361.159226:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788638361.159379:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788638361.159595:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788638361.163859:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788638361.164253:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1788638361.198429:0:5823:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788638361.226314:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788638361.226500:0:5875:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788638361.226505:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788638361.226704:0:5876:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788638361.229192:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788638361.229350:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788638361.229774:0:5823:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788638361.229805:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788638361.229928:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788638361.238629:0:5823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788638361.239229:0:5823:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788638361.239261:0:5823:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1788638361.240232:0:5823:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1788638361.240763:0:5823:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1788638361.242176:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1788638361.242338:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1788638361.242476:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1788638361.245916:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1788638361.246122:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1788638361.246262:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1788638361.246402:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1788638361.247153:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1788638361.247296:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1788638361.247443:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1788638361.247702:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1788638361.247941:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1788638361.248094:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1788638361.248249:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1788638361.248388:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1788638361.249152:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1788638361.249446:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1788638361.249888:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1788638361.250043:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1788638361.250196:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1788638361.250331:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1788638361.250480:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1788638361.250688:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1788638361.250852:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1788638361.251000:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1788638361.251134:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1788638361.251278:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1788638361.251430:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1788638361.251605:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1788638361.251754:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1788638361.251908:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1788638361.252042:0:5823:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1788638361.252238:0:5823:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788638361.272923:0:5876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1788638361.322455:0:5823:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788638361.322498:0:5823:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd4881c9f988 00100000:10000000:1.0:1788638361.322508:0:5823:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788638361.322768:0:5823:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788638361.322803:0:5823:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.134@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788638361.322818:0:5823:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1788638361.322833:0:5823:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1788638361.374537:0:5876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788638361.374627:0:5876:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788638361.374643:0:5876:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788638361.446219:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638362.474400:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638363.487953:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638364.516824:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638365.536888:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788638365.672989:0:6119:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg334-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:0.0:1788638366.432194:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788638366.432204:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788638366.432207:0:36:0:(import.c:65:import_set_state_nolock()) 00000000809f0262 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788638366.432223:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000809f0262 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:0.0:1788638366.432245:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000c30d0e8b x1875523183578368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788638366.432397:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788638366.432411:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b13a3c5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183578240:0@lo:400: 00000100:00100000:1.0:1788638366.432477:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638366.432719:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c30d0e8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875523183578368:0@lo:38: 00000100:00100000:3.0:1788638366.432761:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638366.432894:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183578368 00000100:00100000:2.0:1788638366.432902:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183578368 00000100:00100000:2.0:1788638366.432935:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788638366.432941:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc3cebc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3290:x1875523183578368:12345-0@lo:38: 00010000:00080000:2.0:1788638366.432967:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 129 last 0 00000020:00000080:2.0:1788638366.433001:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa0b1f1e3b4b2a5c0 00000004:00100000:2.0:1788638366.433046:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788638366.433173:0:5844:0:(import.c:65:import_set_state_nolock()) 00000000cd932da8 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788638366.433225:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc3cebc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875523183578368:12345-0@lo:38: Request processed in 283us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638366.433232:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638366.433404:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183578240 00000100:00100000:0.0:1788638366.433410:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183578240 00000100:00100000:0.0:1788638366.433449:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788638366.433456:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005640202b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:3294:x1875523183578240:12345-0@lo:400: 00000100:00100000:0.0:1788638366.433496:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005640202b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:3294:x1875523183578240:12345-0@lo:400: Request processed in 41us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638366.433502:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788638366.433576:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b13a3c5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183578240:0@lo:400: 00010000:00080000:3.0:1788638366.433850:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000c30d0e8b x1875523183578368/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788638376 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788638366.433865:0:3290:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788638366.433873:0:3290:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788638366.433878:0:3290:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788638366.433880:0:3290:0:(import.c:65:import_set_state_nolock()) 00000000809f0262 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788638366.433885:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c30d0e8b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875523183578368:0@lo:38: 00010000:00010000:3.0:1788638366.561900:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638367.584001:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638368.607932:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638369.633728:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788638370.015898:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788638370.015906:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7387a11800 from 3 10000000:01000000:1.0:1788638370.015910:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788638370.015955:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: 000000008fd36eca/0xa0b1f1e3b4b2a5c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638370.015967:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: 000000008fd36eca/0xa0b1f1e3b4b2a5c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638370.015976:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: 000000008fd36eca/0xa0b1f1e3b4b2a5c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638370.015999:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e2114aaa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183578496:0@lo:101: 00000100:00100000:1.0:1788638370.016064:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638370.016137:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set 000000003ac0511d going to sleep for 11 seconds 00000100:00100000:0.0:1788638370.016304:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183578496 00000100:00100000:0.0:1788638370.016313:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183578496 00000100:00100000:0.0:1788638370.016369:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788638370.016377:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b3463332 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:5840:x1875523183578496:12345-0@lo:101: 00010000:00010000:0.0:1788638370.016406:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638370.016420:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000042be5f9e/0xa0b1f1e3b4b2a5ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a5c7 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638370.016443:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000042be5f9e/0xa0b1f1e3b4b2a5ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a5c7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638370.016454:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000042be5f9e/0xa0b1f1e3b4b2a5ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a5c7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638370.016473:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000042be5f9e, rc 0) 00000100:00100000:0.0:1788638370.016528:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b3463332 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:5840:x1875523183578496:12345-0@lo:101: Request processed in 151us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638370.016534:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788638370.016679:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e2114aaa pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183578496:0@lo:101: 00010000:00010000:2.0:1788638370.016704:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: 000000008fd36eca/0xa0b1f1e3b4b2a5c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a5ce expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638370.016712:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: 000000008fd36eca/0xa0b1f1e3b4b2a5c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a5ce expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638370.016759:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004df334a9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183578624:0@lo:256: 00000100:00100000:2.0:1788638370.016830:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638370.016853:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set 0000000077949bfe going to sleep for 11 seconds 00000100:00100000:1.0:1788638370.017120:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183578624 00000100:00100000:1.0:1788638370.017126:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183578624 00000100:00100000:1.0:1788638370.017169:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788638370.017177:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aae65380 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:5840:x1875523183578624:12345-0@lo:256: 20000000:01000000:1.0:1788638370.017192:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788638370.017214:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788638370.017217:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788638370.017302:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aae65380 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:5840:x1875523183578624:12345-0@lo:256: Request processed in 126us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638370.017309:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788638370.017442:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004df334a9 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183578624:0@lo:256: 10000000:01000000:2.0:1788638370.018078:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788638370.018086:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: 000000008fd36eca/0xa0b1f1e3b4b2a5c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a5ce expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638370.018097:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: 000000008fd36eca/0xa0b1f1e3b4b2a5c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a5ce expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788638370.456391:0:6320:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe58fc11f0 20000000:00000080:1.0:1788638370.456415:0:6320:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c7383668400 uarg=0000000000000000 20000000:01000000:1.0:1788638370.456456:0:6320:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788638370.456462:0:6320:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788638370.456468:0:6320:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788638370.456724:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788638370.456736:0:6320:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:1.0:1788638370.461265:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788638370.462976:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788638370.463068:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:1.0:1788638370.463124:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:1.0:1788638370.463146:0:6320:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788638370.463164:0:6320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5d5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638370.463182:0:6320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000002930698f/0xa0b1f1e3b4b2a596 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a58f expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638370.463189:0:6320:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5d5 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638370.463226:0:6320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000002930698f/0xa0b1f1e3b4b2a596 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a58f expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638370.463240:0:6320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000002930698f/0xa0b1f1e3b4b2a596 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a58f expref: 11 pid: 5837 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638370.463265:0:6320:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074779fe5 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1875523183578752:0@lo:104: 00000100:00100000:1.0:1788638370.464790:0:6320:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638370.464937:0:6320:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cc8abdac going to sleep for 11 seconds 00000100:00100000:3.0:1788638370.467691:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183578752 00000100:00100000:3.0:1788638370.467704:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183578752 00000100:00100000:3.0:1788638370.467767:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788638370.467775:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016ce5a39 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:6320:x1875523183578752:12345-0@lo:104: 00010000:00010000:3.0:1788638370.467808:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: 00000000404a044d/0xa0b1f1e3b4b2a58f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a596 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638370.467896:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788638370.467901:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016ce5a39 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:6320:x1875523183578752:12345-0@lo:104: Request processed in 128us (4557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638370.467908:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1788638370.467927:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638370.467931:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: 00000000404a044d/0xa0b1f1e3b4b2a58f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a596 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638370.467939:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000404a044d already unused, calling callback (000000006409b6c2) 10000000:00010000:3.0:1788638370.467942:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: 00000000404a044d/0xa0b1f1e3b4b2a58f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a596 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638370.467949:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: 00000000404a044d/0xa0b1f1e3b4b2a58f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a596 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788638370.467955:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: 00000000404a044d/0xa0b1f1e3b4b2a58f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a596 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638370.467961:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788638370.467991:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: 00000000404a044d/0xa0b1f1e3b4b2a58f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a596 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638370.467997:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788638370.468025:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: 00000000404a044d/0xa0b1f1e3b4b2a58f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a596 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638370.468031:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: 00000000404a044d/0xa0b1f1e3b4b2a58f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a596 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638370.468050:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638370.468052:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638370.468053:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638370.468076:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af996921 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183578880:0@lo:103: 00000100:00100000:3.0:1788638370.468113:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638370.468167:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183578880 00000100:00100000:3.0:1788638370.468172:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183578880 00010000:00010000:3.0:1788638370.468190:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000002930698f/0xa0b1f1e3b4b2a596 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a58f expref: 12 pid: 5837 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638370.468213:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788638370.468218:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e43ad70 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:3294:x1875523183578880:12345-0@lo:103: 00010000:00010000:3.0:1788638370.468226:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638370.468229:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000002930698f/0xa0b1f1e3b4b2a596 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a58f expref: 12 pid: 5837 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638370.468239:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000002930698f/0xa0b1f1e3b4b2a596 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a58f expref: 12 pid: 5837 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638370.468255:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5d5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638370.468262:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5d5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638370.468286:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5d5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638370.468292:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5d5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638370.468298:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5d5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638370.468303:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5d5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638370.468308:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f2e8da0c already unused, calling callback (00000000136e0be3) 00010000:00010000:3.0:1788638370.468311:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5d5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638370.468316:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5d5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638370.468324:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5d5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638370.468334:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638370.468365:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e43ad70 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:3294:x1875523183578880:12345-0@lo:103: Request processed in 146us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638370.468373:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788638370.468388:0:6320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002930698f/0xa0b1f1e3b4b2a596 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a58f expref: 11 pid: 5837 timeout: 283 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638370.468404:0:6320:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074779fe5 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1875523183578752:0@lo:104: 00000100:00100000:3.0:1788638370.468406:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af996921 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183578880:0@lo:103: 00010000:00010000:2.0:1788638370.468430:0:6320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5d5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638370.468441:0:6320:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5d5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638370.468447:0:6320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5d5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638370.468472:0:6320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5d5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638370.656034:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638371.552113:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b13a3c5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183579008:0@lo:400: 00000100:00100000:1.0:1788638371.552190:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638371.554770:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000f3dffdac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183579136:0@lo:400: 00000100:00100000:1.0:1788638371.554855:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638371.560543:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183579008 00000100:00100000:0.0:1788638371.560560:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183579008 00000100:00100000:0.0:1788638371.560584:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183579136 00000100:00100000:0.0:1788638371.560587:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183579136 00000100:00100000:0.0:1788638371.560654:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788638371.560664:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000040b12f77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183579136:12345-0@lo:400: 00000100:00100000:0.0:1788638371.560754:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000040b12f77 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183579136:12345-0@lo:400: Request processed in 92us (5899us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638371.560762:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788638371.560939:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788638371.560945:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9b9be96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:3291:x1875523183579008:12345-0@lo:400: 00000100:00100000:0.0:1788638371.560981:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9b9be96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:3291:x1875523183579008:12345-0@lo:400: Request processed in 36us (8792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638371.560986:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788638371.561105:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f3dffdac x1875523183579136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638371.561120:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000f3dffdac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183579136:0@lo:400: 00000100:00100000:1.0:1788638371.561152:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b13a3c5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183579008:0@lo:400: 00010000:00010000:1.0:1788638371.680693:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638372.704828:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638373.728125:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638374.754733:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638375.775942:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638376.672656:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b83b2b84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183579392:0@lo:400: 00000100:00100000:3.0:1788638376.672772:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638376.672869:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788638376.672876:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000af996921 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183579264:0@lo:400: 00000100:00100000:3.0:1788638376.672909:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638376.672945:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183579264 00000100:00100000:3.0:1788638376.672953:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183579264 00000100:00100000:0.0:1788638376.673157:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183579392 00000100:00100000:0.0:1788638376.673162:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183579392 00000100:00100000:0.0:1788638376.673216:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638376.673225:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b37a9019 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183579392:12345-0@lo:400: 00000100:00100000:0.0:1788638376.673286:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b37a9019 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183579392:12345-0@lo:400: Request processed in 63us (515us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638376.673293:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788638376.673407:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788638376.673414:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089731b65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:3294:x1875523183579264:12345-0@lo:400: 00000100:00100000:3.0:1788638376.673446:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089731b65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:3294:x1875523183579264:12345-0@lo:400: Request processed in 33us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638376.673461:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788638376.673522:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000af996921 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183579264:0@lo:400: 00010000:00080000:3.0:1788638376.673537:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000b83b2b84 x1875523183579392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638392 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638376.673549:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b83b2b84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183579392:0@lo:400: 00000020:01000004:0.0:1788638376.726239:0:6682:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788638376.726244:0:6682:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1788638376.726395:0:6682:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000043d9c482 00000020:01000004:0.0:1788638376.726499:0:6682:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788638376.726514:0:6682:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788638376.726532:0:6682:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000d1758ba8) 00000020:00000080:0.0:1788638376.726553:0:6682:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788638376.746599:0:6682:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788638376.746908:0:6682:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788638376.773364:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788638376.783378:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788638376.783518:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788638376.783586:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788638376.783617:0:6682:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788638376.784273:0:6682:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788638376.784287:0:6682:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788638376.784302:0:6682:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa0b1f1e3b4b2a5e3 00000020:01000004:2.0:1788638376.784310:0:6682:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788638376.784338:0:6682:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.134@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788638376.784342:0:6682:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788638376.784348:0:6682:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788638376.784353:0:6682:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788638376.784367:0:6682:0:(genops.c:413:class_newdev()) Allocate new device OSS (000000000b2983f3) 00000020:00000080:2.0:1788638376.784379:0:6682:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788638376.788340:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788638376.789615:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788638376.789624:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788638376.799950:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788638376.800118:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00010000:00010000:1.0:1788638376.800394:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638376.803675:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788638376.803698:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788638376.807725:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788638376.808276:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788638376.808285:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788638376.809617:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788638376.809628:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788638376.848364:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788638376.848867:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788638376.848875:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788638376.851909:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788638376.851928:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1788638376.855979:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788638376.856000:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788638376.859503:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788638376.859749:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788638376.859756:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1788638376.861105:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1788638376.861114:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788638376.940161:0:6682:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788638376.940414:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788638376.940421:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788638376.942023:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788638376.942039:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788638376.943114:0:6682:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788638376.943156:0:6682:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788638376.943164:0:6682:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.134@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788638376.976225:0:6682:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.134@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788638376.976279:0:6682:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.134@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788638376.976284:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788638376.976291:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788638376.976292:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638376.976293:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638376.976294:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638376.976296:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638376.976297:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788638376.976298:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788638376.976299:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788638376.976301:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638376.976303:0:6682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788638376.976306:0:6682:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788638376.976309:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788638376.976310:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788638376.976311:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638376.976312:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638376.976313:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638376.976314:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638376.976315:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788638376.976316:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788638376.976317:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788638376.976318:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638376.976319:0:6682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788638376.976354:0:6682:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788638376.976377:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009753cdfa pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183579520:0@lo:253: 00000100:00100000:1.0:1788638376.976917:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638376.977052:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 000000008d5c5c0d going to sleep for 11 seconds 00000100:00100000:3.0:1788638376.977261:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183579520 00000100:00100000:3.0:1788638376.977273:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183579520 00000100:00100000:3.0:1788638376.977343:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788638376.977353:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be94c701 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:6682:x1875523183579520:12345-0@lo:253: 20000000:01000000:3.0:1788638376.977390:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788638376.977396:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1788638376.977402:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1788638376.977406:0:5837:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1788638376.978431:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788638376.978658:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788638376.978674:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1788638376.978714:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1788638376.978722:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1788638376.978752:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1788638376.980680:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1788638376.981414:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788638376.981443:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.134@tcp 20000000:01000000:3.0:1788638376.981445:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.134@tcp (null) (null) (null) 00000040:00080000:3.0:1788638376.981494:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788638376.981503:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788638376.981555:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788638376.981564:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.134@tcp (null) (null) 00000040:00080000:3.0:1788638376.982945:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788638376.982972:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788638376.983029:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788638376.983134:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1788638376.984579:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788638376.984613:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.134@tcp 20000000:01000000:3.0:1788638376.984615:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.134@tcp (null) (null) (null) 00000040:00080000:3.0:1788638376.984653:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788638376.984662:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788638376.984696:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788638376.984704:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.134@tcp (null) (null) 00000040:00080000:3.0:1788638376.985116:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788638376.985129:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788638376.985166:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1788638376.985205:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1788638376.985225:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788638376.985230:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788638376.985234:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788638376.985260:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788638376.985263:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788638376.985300:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788638376.985303:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788638376.986619:0:6697:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1788638376.986699:0:6697:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1788638376.987154:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:3.0:1788638376.987558:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:3.0:1788638376.987605:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:3.0:1788638376.987642:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:3.0:1788638376.987655:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788638376.987658:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788638376.989073:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788638376.989645:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788638376.989718:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788638376.990053:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1788638376.990071:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788638376.990074:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788638376.991165:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788638376.991233:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788638376.991293:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788638376.991767:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788638376.991844:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788638376.991904:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788638376.991922:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788638376.991925:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788638376.991936:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788638376.991960:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000361cce8f/0xa0b1f1e3b4b2a5f1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638376.991981:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006159fd04/0xa0b1f1e3b4b2a518 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a511 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638376.991989:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000011b23058/0xa0b1f1e3b4b2a534 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a52d expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638376.991995:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000044c36d03/0xa0b1f1e3b4b2a5a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a59d expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638376.992001:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000361cce8f/0xa0b1f1e3b4b2a5f1 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638376.992057:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000044c36d03/0xa0b1f1e3b4b2a5a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a59d expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638376.992073:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000044c36d03/0xa0b1f1e3b4b2a5a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a59d expref: 11 pid: 5834 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638376.992103:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b83b2b84 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875523183579648:0@lo:104: 00000100:00100000:3.0:1788638376.992181:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788638376.992251:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000011b23058/0xa0b1f1e3b4b2a534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a52d expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638376.992258:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000011b23058/0xa0b1f1e3b4b2a534 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a52d expref: 11 pid: 5835 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638376.992265:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074dd88ee pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875523183579776:0@lo:104: 00000100:00100000:3.0:1788638376.992283:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788638376.992316:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006159fd04/0xa0b1f1e3b4b2a518 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a511 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638376.992323:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006159fd04/0xa0b1f1e3b4b2a518 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a511 expref: 11 pid: 5834 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638376.992330:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000aec7a7bc pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875523183579904:0@lo:104: 00000100:00100000:3.0:1788638376.992349:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638376.992359:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set 00000000b3995317 going to sleep for 11 seconds 00000100:00100000:0.0:1788638376.992606:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183579648 00000100:00100000:0.0:1788638376.992616:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183579648 00000100:00100000:0.0:1788638376.992656:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183579776 00000100:00100000:0.0:1788638376.992659:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183579776 00000100:00100000:0.0:1788638376.992668:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183579904 00000100:00100000:0.0:1788638376.992670:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183579904 00000100:00100000:0.0:1788638376.992681:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788638376.992689:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af996921 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+5:5837:x1875523183579648:12345-0@lo:104: 00010000:00010000:0.0:1788638376.992703:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: 00000000a8ce8a1a/0xa0b1f1e3b4b2a59d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a5a4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.992776:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788638376.992806:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af996921 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+5:5837:x1875523183579648:12345-0@lo:104: Request processed in 118us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638376.992814:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788638376.992833:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788638376.992838:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000098e64fcb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+4:5837:x1875523183579776:12345-0@lo:104: 00010000:00010000:0.0:1788638376.992845:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: 0000000012b694cb/0xa0b1f1e3b4b2a52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a534 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.992880:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788638376.992884:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000098e64fcb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+4:5837:x1875523183579776:12345-0@lo:104: Request processed in 47us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638376.992890:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788638376.992902:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788638376.992907:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029eaef7b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:5837:x1875523183579904:12345-0@lo:104: 00010000:00010000:0.0:1788638376.992913:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: 000000004c6179cd/0xa0b1f1e3b4b2a511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a518 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.992947:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788638376.992951:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029eaef7b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:5837:x1875523183579904:12345-0@lo:104: Request processed in 45us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638376.992957:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788638376.992974:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788638376.992980:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: 00000000a8ce8a1a/0xa0b1f1e3b4b2a59d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a5a4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.992987:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000a8ce8a1a already unused, calling callback (000000006409b6c2) 10000000:00010000:0.0:1788638376.992990:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: 00000000a8ce8a1a/0xa0b1f1e3b4b2a59d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a5a4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.992998:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: 00000000a8ce8a1a/0xa0b1f1e3b4b2a59d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a5a4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638376.993004:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: 00000000a8ce8a1a/0xa0b1f1e3b4b2a59d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a5a4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638376.993010:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788638376.993042:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: 00000000a8ce8a1a/0xa0b1f1e3b4b2a59d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a5a4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.993050:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788638376.993069:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: 00000000a8ce8a1a/0xa0b1f1e3b4b2a59d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a5a4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.993075:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: 00000000a8ce8a1a/0xa0b1f1e3b4b2a59d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a5a4 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.993099:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788638376.993102:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: 0000000012b694cb/0xa0b1f1e3b4b2a52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a534 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.993107:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000012b694cb already unused, calling callback (000000006409b6c2) 10000000:00010000:0.0:1788638376.993109:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: 0000000012b694cb/0xa0b1f1e3b4b2a52d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a534 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.993115:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: 0000000012b694cb/0xa0b1f1e3b4b2a52d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a534 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638376.993121:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: 0000000012b694cb/0xa0b1f1e3b4b2a52d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a534 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638376.993126:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788638376.993138:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: 0000000012b694cb/0xa0b1f1e3b4b2a52d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a534 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.993143:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788638376.993147:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: 0000000012b694cb/0xa0b1f1e3b4b2a52d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a534 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.993153:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: 0000000012b694cb/0xa0b1f1e3b4b2a52d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a534 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.993162:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638376.993164:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: 000000004c6179cd/0xa0b1f1e3b4b2a511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a518 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.993180:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004c6179cd already unused, calling callback (000000006409b6c2) 10000000:00010000:0.0:1788638376.993182:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: 000000004c6179cd/0xa0b1f1e3b4b2a511 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a518 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.993187:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: 000000004c6179cd/0xa0b1f1e3b4b2a511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a518 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638376.993192:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: 000000004c6179cd/0xa0b1f1e3b4b2a511 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a518 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638376.993196:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788638376.993206:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: 000000004c6179cd/0xa0b1f1e3b4b2a511 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a518 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.993212:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788638376.993226:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: 000000004c6179cd/0xa0b1f1e3b4b2a511 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a518 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.993231:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: 000000004c6179cd/0xa0b1f1e3b4b2a511 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a518 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.993244:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638376.993245:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638376.993247:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638376.993270:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000097e946e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183580032:0@lo:103: 00000100:00100000:0.0:1788638376.993300:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638376.993329:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638376.993334:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001c645884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183580160:0@lo:103: 00000100:00100000:0.0:1788638376.993361:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638376.993582:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a429522b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183580288:0@lo:103: 00000100:00100000:0.0:1788638376.993605:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638376.993636:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183580032 00000100:00100000:0.0:1788638376.993640:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183580032 00010000:00010000:0.0:1788638376.993659:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000044c36d03/0xa0b1f1e3b4b2a5a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a59d expref: 12 pid: 5834 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638376.993673:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183580160 00000100:00100000:0.0:1788638376.993675:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183580160 00010000:00010000:0.0:1788638376.993682:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000011b23058/0xa0b1f1e3b4b2a534 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a52d expref: 13 pid: 5835 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638376.993690:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183580288 00000100:00100000:0.0:1788638376.993692:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183580288 00010000:00010000:0.0:1788638376.993699:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006159fd04/0xa0b1f1e3b4b2a518 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a511 expref: 14 pid: 5834 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638376.993709:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788638376.993714:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dcb557bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:3291:x1875523183580032:12345-0@lo:103: 00010000:00010000:0.0:1788638376.993987:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638376.993994:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000044c36d03/0xa0b1f1e3b4b2a5a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a59d expref: 14 pid: 5834 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.994006:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000044c36d03/0xa0b1f1e3b4b2a5a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a59d expref: 14 pid: 5834 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.994025:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638376.994056:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dcb557bb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:3291:x1875523183580032:12345-0@lo:103: Request processed in 342us (756us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638376.994073:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788638376.994091:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788638376.994097:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe91e55c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:3291:x1875523183580160:12345-0@lo:103: 00010000:00010000:0.0:1788638376.994116:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638376.994119:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000011b23058/0xa0b1f1e3b4b2a534 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a52d expref: 13 pid: 5835 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.994128:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000011b23058/0xa0b1f1e3b4b2a534 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a52d expref: 13 pid: 5835 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.994137:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638376.994159:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe91e55c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:3291:x1875523183580160:12345-0@lo:103: Request processed in 63us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638376.994165:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788638376.994177:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788638376.994182:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d76dda03 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:3293:x1875523183580288:12345-0@lo:103: 00010000:00010000:0.0:1788638376.994188:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638376.994191:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006159fd04/0xa0b1f1e3b4b2a518 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a511 expref: 12 pid: 5834 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.994199:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006159fd04/0xa0b1f1e3b4b2a518 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a511 expref: 12 pid: 5834 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.994210:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000361cce8f/0xa0b1f1e3b4b2a5f1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.994217:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000361cce8f/0xa0b1f1e3b4b2a5f1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.994241:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000361cce8f/0xa0b1f1e3b4b2a5f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.994247:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000361cce8f/0xa0b1f1e3b4b2a5f1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.994252:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000361cce8f/0xa0b1f1e3b4b2a5f1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.994256:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000361cce8f/0xa0b1f1e3b4b2a5f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.994261:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000361cce8f already unused, calling callback (00000000136e0be3) 00010000:00010000:0.0:1788638376.994264:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000361cce8f/0xa0b1f1e3b4b2a5f1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.994271:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000361cce8f/0xa0b1f1e3b4b2a5f1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.994278:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000361cce8f/0xa0b1f1e3b4b2a5f1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638376.994287:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638376.994314:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d76dda03 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:3293:x1875523183580288:12345-0@lo:103: Request processed in 133us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638376.994320:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788638376.995134:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638376.995351:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a429522b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183580288:0@lo:103: 00000100:00100000:0.0:1788638376.995499:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001c645884 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183580160:0@lo:103: 00000100:00100000:0.0:1788638376.995509:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000097e946e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183580032:0@lo:103: 00010000:00010000:2.0:1788638376.995640:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000044c36d03/0xa0b1f1e3b4b2a5a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a59d expref: 11 pid: 5834 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638376.995656:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b83b2b84 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875523183579648:0@lo:104: 00010000:00010000:2.0:1788638376.995666:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000011b23058/0xa0b1f1e3b4b2a534 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a52d expref: 10 pid: 5835 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638376.995682:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074dd88ee pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875523183579776:0@lo:104: 00010000:00010000:2.0:1788638376.995695:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006159fd04/0xa0b1f1e3b4b2a518 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a511 expref: 9 pid: 5834 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638376.995703:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000aec7a7bc pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875523183579904:0@lo:104: 00010000:00010000:2.0:1788638376.995937:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000361cce8f/0xa0b1f1e3b4b2a5f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638376.995948:0:5837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000361cce8f/0xa0b1f1e3b4b2a5f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638376.995954:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000361cce8f/0xa0b1f1e3b4b2a5f1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638376.995959:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000361cce8f/0xa0b1f1e3b4b2a5f1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788638376.995977:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788638377.053171:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be94c701 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+8:6682:x1875523183579520:12345-0@lo:253: Request processed in 75807us (76243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638377.053193:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788638377.053227:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009753cdfa pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183579520:0@lo:253: 10000000:01000000:1.0:1788638377.053250:0:6682:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788638377.053272:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788638377.053274:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788638377.053276:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638377.053277:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1788638377.053279:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638377.053281:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638377.053282:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788638377.053283:0:6682:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788638377.053285:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638377.053286:0:6682:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788638377.053310:0:6682:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000043d9c482 from lustre-OST0000 10000000:01000000:1.0:1788638377.053340:0:6682:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1788638377.053343:0:6682:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788638377.053351:0:6682:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c738375b380 local copy 10000000:01000000:1.0:1788638377.053355:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788638377.053397:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.053406:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.134@tcp lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.053414:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638377.053434:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009753cdfa pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183580416:0@lo:101: 00000100:00100000:1.0:1788638377.053504:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638377.053611:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 0000000021518cfe going to sleep for 11 seconds 00000100:00100000:0.0:1788638377.053722:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183580416 00000100:00100000:0.0:1788638377.053738:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183580416 00000100:00100000:0.0:1788638377.053861:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788638377.053871:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000503437e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+8:6682:x1875523183580416:12345-0@lo:101: 00010000:00010000:0.0:1788638377.053884:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638377.053899:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000012b694cb/0xa0b1f1e3b4b2a5ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a5f8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638377.053926:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000012b694cb/0xa0b1f1e3b4b2a5ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a5f8 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638377.053946:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000012b694cb/0xa0b1f1e3b4b2a5ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a5f8 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638377.054044:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000012b694cb, rc 0) 00000100:00100000:0.0:1788638377.054086:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000503437e5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+9:6682:x1875523183580416:12345-0@lo:101: Request processed in 218us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638377.054090:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788638377.054154:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009753cdfa pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183580416:0@lo:101: 00010000:00010000:1.0:1788638377.054168:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa0b1f1e3b4b2a5ff expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.054177:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa0b1f1e3b4b2a5ff expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638377.054310:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009753cdfa pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183580544:0@lo:501: 00000100:00100000:1.0:1788638377.054340:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638377.054761:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 0000000021518cfe going to sleep for 11 seconds 00000100:00100000:3.0:1788638377.055191:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183580544 00000100:00100000:3.0:1788638377.055200:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183580544 00000100:00100000:2.0:1788638377.055248:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788638377.055261:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c154a8e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+9:6682:x1875523183580544:12345-0@lo:501: 00000100:00100000:2.0:1788638377.055631:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c154a8e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+9:6682:x1875523183580544:12345-0@lo:501: Request processed in 374us (1291us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788638377.055640:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788638377.055715:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009753cdfa pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183580544:0@lo:501: 10000000:01000000:1.0:1788638377.055736:0:6682:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788638377.055772:0:6682:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788638377.055779:0:6682:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa0b1f1e3b4b2a5ff expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.056773:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa0b1f1e3b4b2a5ff expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.056807:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa0b1f1e3b4b2a5ff expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638377.057044:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788638377.057055:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638377.057061:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa0b1f1e3b4b2a5ff expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.057068:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f2e8da0c already unused, calling callback (000000006409b6c2) 10000000:00010000:1.0:1788638377.057071:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa0b1f1e3b4b2a5ff expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638377.057075:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c73bce5d800 00010000:00010000:1.0:1788638377.057080:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xa0b1f1e3b4b2a5ff expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638377.057081:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:00010000:1.0:1788638377.057087:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xa0b1f1e3b4b2a5ff expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638377.057087:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c738375b380 10000000:01000000:0.0:1788638377.057089:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788638377.057092:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c738375b380 from 1 10000000:01000000:0.0:1788638377.057095:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 10000000:01000000:1.0:1788638377.057105:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788638377.057126:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa0b1f1e3b4b2a5ff expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.057132:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788638377.057132:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: 00000000390f1d72/0xa0b1f1e3b4b2a606 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638377.057138:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: 00000000390f1d72/0xa0b1f1e3b4b2a606 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638377.057156:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: 00000000390f1d72/0xa0b1f1e3b4b2a606 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.057167:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa0b1f1e3b4b2a5ff expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.057173:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: 00000000f2e8da0c/0xa0b1f1e3b4b2a5f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa0b1f1e3b4b2a5ff expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638377.057176:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000097e946e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183580672:0@lo:101: 00010000:00010000:1.0:1788638377.057193:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638377.057194:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638377.057196:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638377.057241:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009753cdfa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183580800:0@lo:103: 00000100:00100000:0.0:1788638377.057247:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638377.057284:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638377.057291:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 0000000092267582 going to sleep for 11 seconds 00000100:00100000:3.0:1788638377.057321:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183580800 00000100:00100000:3.0:1788638377.057329:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183580800 00000100:00100000:3.0:1788638377.057377:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638377.057386:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f0c723ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+9:3294:x1875523183580800:12345-0@lo:103: 00010000:00010000:3.0:1788638377.057399:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638377.057412:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000012b694cb/0xa0b1f1e3b4b2a5ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a5f8 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638377.057428:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638377.057476:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f0c723ef pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+8:3294:x1875523183580800:12345-0@lo:103: Request processed in 92us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638377.057484:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788638377.057533:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183580672 00000100:00100000:1.0:1788638377.057538:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183580672 00000100:00100000:1.0:1788638377.057569:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788638377.057569:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009753cdfa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183580800:0@lo:103: 00000100:00100000:1.0:1788638377.057575:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c0269010 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+8:6682:x1875523183580672:12345-0@lo:101: 00010000:00010000:1.0:1788638377.057585:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638377.057596:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003b7ed5df/0xa0b1f1e3b4b2a60d lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a606 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.057621:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003b7ed5df/0xa0b1f1e3b4b2a60d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a606 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.057632:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003b7ed5df/0xa0b1f1e3b4b2a60d lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a606 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.057642:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003b7ed5df, rc 0) 00000100:00100000:1.0:1788638377.057690:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c0269010 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+9:6682:x1875523183580672:12345-0@lo:101: Request processed in 115us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638377.057699:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788638377.057771:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000097e946e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183580672:0@lo:101: 00010000:00010000:0.0:1788638377.057885:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: 00000000390f1d72/0xa0b1f1e3b4b2a606 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a60d expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638377.057895:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: 00000000390f1d72/0xa0b1f1e3b4b2a606 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a60d expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638377.057914:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788638377.058073:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: 00000000390f1d72/0xa0b1f1e3b4b2a606 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a60d expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638377.058081:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: 00000000390f1d72/0xa0b1f1e3b4b2a606 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a60d expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638377.058088:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788638377.058092:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788638377.058097:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788638377.058099:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788638377.058114:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: 0000000011b23058/0xa0b1f1e3b4b2a614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638377.058128:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: 0000000011b23058/0xa0b1f1e3b4b2a614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638377.058133:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: 0000000011b23058/0xa0b1f1e3b4b2a614 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638377.058141:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000097e946e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183580928:0@lo:101: 00000100:00100000:0.0:1788638377.058162:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638377.058187:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 0000000092267582 going to sleep for 11 seconds 00000100:00100000:2.0:1788638377.058205:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183580928 00000100:00100000:2.0:1788638377.058215:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183580928 00000100:00100000:2.0:1788638377.058247:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788638377.058258:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac991588 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+9:6682:x1875523183580928:12345-0@lo:101: 00010000:00010000:2.0:1788638377.058265:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638377.058274:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000808447a6/0xa0b1f1e3b4b2a61b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a614 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638377.058287:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000808447a6/0xa0b1f1e3b4b2a61b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a614 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638377.058295:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000808447a6/0xa0b1f1e3b4b2a61b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a614 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638377.058302:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000808447a6, rc 0) 00000100:00100000:2.0:1788638377.058335:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac991588 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+10:6682:x1875523183580928:12345-0@lo:101: Request processed in 78us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638377.058340:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788638377.058360:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000097e946e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183580928:0@lo:101: 00010000:00010000:0.0:1788638377.058370:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: 0000000011b23058/0xa0b1f1e3b4b2a614 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a61b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638377.058377:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: 0000000011b23058/0xa0b1f1e3b4b2a614 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a61b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638377.058482:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000097e946e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183581056:0@lo:501: 00000100:00100000:0.0:1788638377.058523:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638377.058572:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 0000000092267582 going to sleep for 11 seconds 00000100:00100000:3.0:1788638377.058611:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183581056 00000100:00100000:3.0:1788638377.058615:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183581056 00000100:00100000:3.0:1788638377.058644:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788638377.058650:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b23e52a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+10:6682:x1875523183581056:12345-0@lo:501: 00000100:00100000:3.0:1788638377.059040:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b23e52a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+10:6682:x1875523183581056:12345-0@lo:501: Request processed in 389us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638377.059048:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788638377.059173:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000097e946e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183581056:0@lo:501: 00000100:00100000:0.0:1788638377.059208:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000097e946e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183581184:0@lo:503: 00000100:00100000:0.0:1788638377.059236:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638377.059263:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 0000000092267582 going to sleep for 11 seconds 00000100:00100000:2.0:1788638377.059281:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183581184 00000100:00100000:2.0:1788638377.059286:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183581184 00000100:00100000:2.0:1788638377.059318:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788638377.059324:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032838665 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+10:6682:x1875523183581184:12345-0@lo:503: 00000100:00100000:2.0:1788638377.059595:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032838665 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+10:6682:x1875523183581184:12345-0@lo:503: Request processed in 272us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638377.059601:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788638377.059650:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000097e946e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183581184:0@lo:503: 00000040:00080000:0.0:1788638377.060159:0:6682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788638377.060234:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000097e946e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183581312:0@lo:502: 00000100:00100000:0.0:1788638377.060277:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638377.060389:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 0000000092267582 going to sleep for 11 seconds 00000100:00100000:3.0:1788638377.060628:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183581312 00000100:00100000:3.0:1788638377.060633:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183581312 00000100:00100000:3.0:1788638377.060665:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788638377.060672:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067b5bdfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+10:6682:x1875523183581312:12345-0@lo:502: 00000100:00100000:3.0:1788638377.061198:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067b5bdfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+10:6682:x1875523183581312:12345-0@lo:502: Request processed in 526us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638377.061205:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788638377.061269:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000097e946e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183581312:0@lo:502: 00000040:00080000:0.0:1788638377.061498:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788638377.061550:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788638377.061585:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788638377.061631:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788638377.061654:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788638377.061670:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788638377.061697:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000097e946e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183581440:0@lo:502: 00000100:00100000:0.0:1788638377.061740:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638377.061869:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 0000000092267582 going to sleep for 11 seconds 00000100:00100000:2.0:1788638377.061976:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183581440 00000100:00100000:2.0:1788638377.061983:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183581440 00000100:00100000:2.0:1788638377.062023:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788638377.062030:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000042572dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+10:6682:x1875523183581440:12345-0@lo:502: 00000100:00100000:2.0:1788638377.062265:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000042572dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+10:6682:x1875523183581440:12345-0@lo:502: Request processed in 236us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638377.062279:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788638377.062316:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000097e946e3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183581440:0@lo:502: 00000040:00080000:0.0:1788638377.062394:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788638377.062401:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788638377.063217:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788638377.063228:0:6702:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788638377.063236:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638377.063239:0:6702:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788638377.063249:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788638377.063265:0:6702:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000fc5868e1) 00000020:00000080:2.0:1788638377.063291:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788638377.063297:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788638377.063381:0:6702:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000043d9c482 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788638377.063387:0:6702:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788638377.063393:0:6702:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa0b1f1e3b4b2a629 00010000:00010000:2.0:1788638377.069165:0:6702:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788638377.069904:0:6702:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788638377.077087:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788638377.081345:0:6702:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788638377.091759:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788638377.093236:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788638377.095910:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788638377.095929:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638377.095937:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638377.095940:0:6702:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788638377.095944:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788638377.095949:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638377.095950:0:6702:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788638377.095953:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788638377.095954:0:6702:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788638377.096032:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638377.096036:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638377.096037:0:6702:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788638377.096040:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788638377.096264:0:6682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788638377.096294:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788638377.096318:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: 0000000011b23058/0xa0b1f1e3b4b2a614 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a61b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638377.096334:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: 0000000011b23058/0xa0b1f1e3b4b2a614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a61b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638377.096342:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c73bce5d800 from 1 10000000:01000000:2.0:1788638377.096346:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788638377.096393:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: 000000002db7c20a/0xa0b1f1e3b4b2a630 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638377.096402:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: 000000002db7c20a/0xa0b1f1e3b4b2a630 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638377.096429:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: 000000002db7c20a/0xa0b1f1e3b4b2a630 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638377.096481:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004df334a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183581568:0@lo:101: 00000100:00100000:2.0:1788638377.096575:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638377.096636:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 00000000df0b74dd going to sleep for 11 seconds 00000100:00100000:0.0:1788638377.096861:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183581568 00000100:00100000:0.0:1788638377.096877:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183581568 00000100:00100000:0.0:1788638377.096935:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788638377.096945:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019fa06c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+10:6682:x1875523183581568:12345-0@lo:101: 00010000:00010000:0.0:1788638377.096960:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638377.096985:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f55b2ef7/0xa0b1f1e3b4b2a637 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a630 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638377.097013:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f55b2ef7/0xa0b1f1e3b4b2a637 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a630 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638377.097024:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f55b2ef7/0xa0b1f1e3b4b2a637 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a630 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638377.097034:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f55b2ef7, rc 0) 00000100:00100000:0.0:1788638377.097103:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019fa06c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:6682:x1875523183581568:12345-0@lo:101: Request processed in 160us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638377.097110:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788638377.097248:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004df334a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183581568:0@lo:101: 00010000:00010000:2.0:1788638377.097264:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: 000000002db7c20a/0xa0b1f1e3b4b2a630 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a637 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638377.097273:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: 000000002db7c20a/0xa0b1f1e3b4b2a630 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a637 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638377.097376:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004df334a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183581696:0@lo:501: 00000100:00100000:2.0:1788638377.097403:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638377.097434:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 00000000df0b74dd going to sleep for 11 seconds 00000100:00100000:0.0:1788638377.097443:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183581696 00000100:00100000:0.0:1788638377.097457:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183581696 00000100:00100000:0.0:1788638377.098128:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788638377.098138:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016cb6b8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:6682:x1875523183581696:12345-0@lo:501: 00000100:00100000:0.0:1788638377.098389:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016cb6b8f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:6682:x1875523183581696:12345-0@lo:501: Request processed in 253us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638377.098397:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788638377.098485:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004df334a9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183581696:0@lo:501: 00000100:00100000:3.0:1788638377.098525:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000256a2276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183581824:0@lo:503: 00000100:00100000:3.0:1788638377.098567:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638377.098814:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f6ad0ffe going to sleep for 11 seconds 00000100:00100000:1.0:1788638377.098899:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183581824 00000100:00100000:1.0:1788638377.098905:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183581824 00000100:00100000:1.0:1788638377.098935:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788638377.098942:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000846c8442 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:6682:x1875523183581824:12345-0@lo:503: 00000100:00100000:1.0:1788638377.099389:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000846c8442 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:6682:x1875523183581824:12345-0@lo:503: Request processed in 447us (822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638377.099398:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788638377.099595:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000256a2276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183581824:0@lo:503: 00000040:00080000:3.0:1788638377.100139:0:6682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788638377.100213:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000256a2276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183581952:0@lo:502: 00000100:00100000:3.0:1788638377.100266:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638377.100554:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183581952 00000100:00100000:0.0:1788638377.100561:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183581952 00000100:00100000:0.0:1788638377.100603:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788638377.100610:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000030f6b03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:6682:x1875523183581952:12345-0@lo:502: 00000100:00100000:0.0:1788638377.100835:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000030f6b03 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:6682:x1875523183581952:12345-0@lo:502: Request processed in 225us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638377.100851:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788638377.101036:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f6ad0ffe going to sleep for 11 seconds 00000100:00100000:3.0:1788638377.101057:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000256a2276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183581952:0@lo:502: 00000040:00080000:3.0:1788638377.101331:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788638377.101390:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788638377.101416:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000256a2276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183582080:0@lo:502: 00000100:00100000:3.0:1788638377.102701:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638377.102863:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f6ad0ffe going to sleep for 11 seconds 00000100:00100000:0.0:1788638377.102949:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183582080 00000100:00100000:0.0:1788638377.102958:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183582080 00000100:00100000:0.0:1788638377.103050:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788638377.103060:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1a161fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:6682:x1875523183582080:12345-0@lo:502: 00000100:00100000:0.0:1788638377.103299:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1a161fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:6682:x1875523183582080:12345-0@lo:502: Request processed in 240us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638377.103306:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788638377.103398:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000256a2276 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183582080:0@lo:502: 00000040:00080000:3.0:1788638377.103548:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788638377.103563:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788638377.104282:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788638377.104295:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638377.104299:0:6706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788638377.104307:0:6706:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c73bce5d800 00000020:00000080:1.0:1788638377.104310:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788638377.104356:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788638377.104360:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638377.104361:0:6706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788638377.104364:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788638377.104566:0:6682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788638377.104585:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788638377.104639:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6600/0xa0b1f1e3b4b2a630 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a637 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638377.104664:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6600/0xa0b1f1e3b4b2a630 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a637 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638377.104705:0:6682:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788638377.104709:0:6682:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c73bce5d800 10000000:01000000:3.0:1788638377.104712:0:6682:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c73bce5d800 10000000:01000000:3.0:1788638377.104715:0:6682:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788638377.104721:0:6682:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c73bce5d800 from 1 10000000:01000000:3.0:1788638377.104724:0:6682:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788638377.104763:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a63e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638377.104951:0:6682:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a63e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638377.104962:0:6682:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a63e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638377.105048:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183582208:0@lo:101: 00000100:00100000:3.0:1788638377.105115:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638377.105196:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73984f30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638377.105240:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183582208 00000100:00100000:1.0:1788638377.105248:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183582208 00000100:00100000:1.0:1788638377.105326:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788638377.105337:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:6682:x1875523183582208:12345-0@lo:101: 00010000:00010000:1.0:1788638377.105350:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638377.105367:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7381685a00/0xa0b1f1e3b4b2a645 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a63e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.105397:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7381685a00/0xa0b1f1e3b4b2a645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a63e expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.105420:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7381685a00/0xa0b1f1e3b4b2a645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a63e expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.105429:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7381685a00, rc 0) 00000100:00100000:1.0:1788638377.105492:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:6682:x1875523183582208:12345-0@lo:101: Request processed in 157us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638377.105498:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788638377.105566:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183582208:0@lo:101: 00010000:00010000:0.0:1788638377.105583:0:6682:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a63e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a645 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638377.105593:0:6682:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a63e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a645 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638377.105687:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183582336:0@lo:501: 00000100:00100000:0.0:1788638377.105715:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638377.105909:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183582336 00000100:00100000:3.0:1788638377.105914:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183582336 00000100:00100000:3.0:1788638377.105939:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788638377.105946:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:6682:x1875523183582336:12345-0@lo:501: 00000100:00100000:3.0:1788638377.106226:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:6682:x1875523183582336:12345-0@lo:501: Request processed in 279us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638377.106232:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788638377.106367:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73879730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638377.106382:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183582336:0@lo:501: 00000100:00100000:0.0:1788638377.106412:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183582464:0@lo:503: 00000100:00100000:0.0:1788638377.106461:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638377.106513:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73879730c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638377.106547:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183582464 00000100:00100000:3.0:1788638377.106552:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183582464 00000100:00100000:3.0:1788638377.106613:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788638377.106621:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:6682:x1875523183582464:12345-0@lo:503: 00000100:00100000:3.0:1788638377.106945:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:6682:x1875523183582464:12345-0@lo:503: Request processed in 324us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638377.106953:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788638377.107090:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183582464:0@lo:503: 00000040:00080000:0.0:1788638377.107373:0:6682:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788638377.107432:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183582592:0@lo:502: 00000100:00100000:0.0:1788638377.107488:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638377.107554:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73879730c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638377.107596:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183582592 00000100:00100000:3.0:1788638377.107602:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183582592 00000100:00100000:3.0:1788638377.107639:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788638377.107646:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:6682:x1875523183582592:12345-0@lo:502: 00000100:00100000:0.0:1788638377.108046:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183582592:0@lo:502: 00000040:00080000:0.0:1788638377.108290:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788638377.108335:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788638377.108378:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788638377.108419:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788638377.108464:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788638377.108514:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788638377.108549:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788638377.108582:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788638377.108630:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788638377.108668:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788638377.108724:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788638377.108862:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788638377.108902:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788638377.108930:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788638377.109078:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788638377.109120:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788638377.109157:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788638377.109202:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788638377.109251:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788638377.109288:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788638377.109348:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788638377.109387:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788638377.109420:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788638377.109482:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788638377.109517:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788638377.109550:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788638377.109609:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788638377.109648:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788638377.109697:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183582720:0@lo:502: 00000100:00100000:3.0:1788638377.110664:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:6682:x1875523183582592:12345-0@lo:502: Request processed in 323us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638377.110678:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788638377.110907:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638377.111004:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73879730c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638377.111100:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183582720 00000100:00100000:3.0:1788638377.111110:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183582720 00000100:00100000:3.0:1788638377.111163:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788638377.111171:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:6682:x1875523183582720:12345-0@lo:502: 00000100:00100000:3.0:1788638377.111427:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:6682:x1875523183582720:12345-0@lo:502: Request processed in 256us (1659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638377.111434:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788638377.111535:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183582720:0@lo:502: 00000040:00080000:0.0:1788638377.111636:0:6682:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788638377.111651:0:6682:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788638377.112294:0:6707:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788638377.112311:0:6707:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c73ad9c19c0) 00000020:00000080:2.0:1788638377.112332:0:6707:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1788638377.112412:0:6707:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c73bce5d800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788638377.112416:0:6707:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c73bce5d800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788638377.112419:0:6707:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c73bce5d800 3 00010000:00080000:2.0:1788638377.112467:0:6707:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c73b7e9b800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.134@tcp at head 00010000:00010000:2.0:1788638377.115725:0:6707:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1788638377.116220:0:6707:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788638377.116261:0:6707:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788638377.116277:0:6707:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa0b1f1e3b4b2a653 00000100:00080000:2.0:1788638377.116298:0:6707:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788638377.116304:0:6707:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c73b7e9b800 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:2.0:1788638377.116352:0:6707:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73837d7800 x1875523183582848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788638377.116421:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1875523183582848:0@lo:38: 00000100:00100000:1.0:1788638377.116523:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788638377.116670:0:6707:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788638377.116838:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183582976:0@lo:400: 00000100:00100000:3.0:1788638377.116872:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638377.116923:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183582848 00000100:00100000:3.0:1788638377.116932:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183582848 00000100:00100000:3.0:1788638377.116964:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183582976 00000100:00100000:3.0:1788638377.117050:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183582976 00000100:00100000:3.0:1788638377.117084:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638377.117106:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183582976:12345-0@lo:400: 00000100:00100000:3.0:1788638377.117164:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183582976:12345-0@lo:400: Request processed in 60us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638377.117171:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638377.117191:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638377.117195:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3290:x1875523183582848:12345-0@lo:38: 00010000:00080000:3.0:1788638377.117218:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 140 last 0 00000020:00000080:3.0:1788638377.117267:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa0b1f1e3b4b2a65a 00000004:00100000:3.0:1788638377.117285:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788638377.117321:0:5843:0:(import.c:65:import_set_state_nolock()) ffff9c73bf0e9000 : changing import state from RECOVER to FULL 00000040:00080000:2.0:1788638377.119334:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1788638377.120491:0:6682:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788638377.120530:0:6682:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788638377.120551:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a63e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a645 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638377.120566:0:6682:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a63e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a645 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788638377.120642:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788638377.120645:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788638377.120646:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788638377.120647:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788638377.120648:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788638377.120650:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788638377.120651:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788638377.120652:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788638377.120653:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788638377.120655:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788638377.120656:0:6682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788638377.120661:0:6682:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1788638377.120663:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788638377.120664:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788638377.120665:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788638377.120666:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788638377.120667:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788638377.120668:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788638377.120669:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788638377.120671:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788638377.120676:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788638377.120677:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788638377.120678:0:6682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788638377.120710:0:6682:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788638377.120734:0:6682:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183583104:0@lo:253: 00000100:00100000:0.0:1788638377.120850:0:6682:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638377.120899:0:6682:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bf2ad900 going to sleep for 11 seconds 00000100:00100000:3.0:1788638377.121068:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875523183582848:12345-0@lo:38: Request processed in 3868us (4543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638377.121081:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638377.121114:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183583104 00000100:00100000:3.0:1788638377.121122:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183583104 00000100:00100000:3.0:1788638377.121166:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788638377.121175:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:6682:x1875523183583104:12345-0@lo:253: 20000000:01000000:3.0:1788638377.121202:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788638377.121218:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1788638377.121715:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c73acdcbb80 x1875523183582976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638377.121731:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183582976:0@lo:400: 00010000:00080000:1.0:1788638377.123421:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c73837d7800 x1875523183582848/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788638387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638377.123435:0:3290:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788638377.123446:0:3290:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1788638377.123465:0:3290:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788638377.123472:0:3290:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788638377.123476:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73b7e9b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788638377.123484:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1875523183582848:0@lo:38: 20000000:01000000:2.0:1788638377.154778:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788638377.154823:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788638377.155325:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788638377.155331:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788638377.155360:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7381684600/0xa0b1f1e3b4b2a661 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.155384:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a5ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a5c7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.155393:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7381684600/0xa0b1f1e3b4b2a661 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.155471:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a5ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a5c7 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.155488:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a5ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a5c7 expref: 12 pid: 5835 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638377.155505:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875523183583232:0@lo:104: 00000100:00100000:1.0:1788638377.155595:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638377.155751:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d8ecc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638377.157993:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183583232 00000100:00100000:0.0:1788638377.158012:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183583232 00000100:00100000:0.0:1788638377.158140:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788638377.158152:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:5858:x1875523183583232:12345-0@lo:104: 00010000:00010000:0.0:1788638377.158173:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c7381684a00/0xa0b1f1e3b4b2a5c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a5ce expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638377.158275:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788638377.158281:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:5858:x1875523183583232:12345-0@lo:104: Request processed in 133us (2687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638377.158289:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788638377.158434:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638377.158442:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7381684a00/0xa0b1f1e3b4b2a5c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a5ce expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.158460:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7381684a00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:1.0:1788638377.158473:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7381684a00/0xa0b1f1e3b4b2a5c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a5ce expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.158483:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7381684a00/0xa0b1f1e3b4b2a5c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a5ce expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638377.158490:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7381684a00/0xa0b1f1e3b4b2a5c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a5ce expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638377.158496:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788638377.158550:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7381684a00/0xa0b1f1e3b4b2a5c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a5ce expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.158557:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788638377.158581:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7381684a00/0xa0b1f1e3b4b2a5c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a5ce expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.158607:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7381684a00/0xa0b1f1e3b4b2a5c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a5ce expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.158629:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638377.158631:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638377.158633:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638377.158651:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3292:1875523183583360:0@lo:103: 00000100:00100000:1.0:1788638377.158700:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638377.158760:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183583360 00000100:00100000:1.0:1788638377.158764:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183583360 00010000:00010000:1.0:1788638377.158815:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a5ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a5c7 expref: 13 pid: 5835 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638377.158837:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788638377.158844:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dfc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:3292:x1875523183583360:12345-0@lo:103: 00010000:00010000:1.0:1788638377.158856:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638377.158862:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a5ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a5c7 expref: 13 pid: 5835 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.158874:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a5ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a5c7 expref: 13 pid: 5835 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.158898:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7381684600/0xa0b1f1e3b4b2a661 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.158910:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7381684600/0xa0b1f1e3b4b2a661 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788638377.158932:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003600654s 00010000:00010000:1.0:1788638377.158944:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7381684600/0xa0b1f1e3b4b2a661 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.158953:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7381684600/0xa0b1f1e3b4b2a661 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.158960:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7381684600/0xa0b1f1e3b4b2a661 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.158967:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7381684600/0xa0b1f1e3b4b2a661 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.158972:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7381684600 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638377.158978:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7381684600/0xa0b1f1e3b4b2a661 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.158986:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7381684600/0xa0b1f1e3b4b2a661 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.158996:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7381684600/0xa0b1f1e3b4b2a661 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.159008:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638377.159041:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dfc450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:3292:x1875523183583360:12345-0@lo:103: Request processed in 197us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638377.159049:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788638377.159143:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3292:1875523183583360:0@lo:103: 00010000:00010000:1.0:1788638377.159178:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a5ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a5c7 expref: 12 pid: 5835 timeout: 290 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638377.159190:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30c380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875523183583232:0@lo:104: 00010000:00010000:1.0:1788638377.159211:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7381684600/0xa0b1f1e3b4b2a661 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.159222:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7381684600/0xa0b1f1e3b4b2a661 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.159228:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7381684600/0xa0b1f1e3b4b2a661 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638377.159235:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7381684600/0xa0b1f1e3b4b2a661 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638377.170919:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:6682:x1875523183583104:12345-0@lo:253: Request processed in 49731us (50056us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638377.170937:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788638377.171084:0:6682:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6682:1875523183583104:0@lo:253: 10000000:01000000:0.0:1788638377.171104:0:6682:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788638377.171108:0:6682:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788638377.171110:0:6682:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788638377.171111:0:6682:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788638377.171113:0:6682:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788638377.171114:0:6682:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788638377.171116:0:6682:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788638377.171117:0:6682:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788638377.171119:0:6682:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788638377.171120:0:6682:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788638377.171122:0:6682:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788638377.171124:0:6682:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788638377.171141:0:6682:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788638377.176768:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788638377.177162:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788638377.177378:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788638377.179174:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788638377.179401:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788638377.180423:0:6682:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788638377.182919:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788638377.418680:0:6682:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788638377.418692:0:6682:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788638377.418802:0:6682:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788638377.418889:0:6682:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.134@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788638377.418907:0:6682:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788638377.418938:0:6682:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788638377.832237:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638378.851140:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788638378.977283:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788638378.977304:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7387a11800 from 21 10000000:01000000:0.0:1788638378.977311:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788638378.977373:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638378.977386:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638378.977409:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a668 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638378.977447:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183583488:0@lo:101: 00000100:00100000:0.0:1788638378.977541:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638378.977657:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bf2ad480 going to sleep for 11 seconds 00000100:00100000:1.0:1788638378.981932:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183583488 00000100:00100000:1.0:1788638378.981953:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183583488 00000100:00100000:1.0:1788638378.982026:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788638378.982039:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:5840:x1875523183583488:12345-0@lo:101: 00010000:00010000:1.0:1788638378.982059:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638378.982083:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a66f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a668 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638378.982121:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a66f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a668 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638378.982134:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a66f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a668 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638378.982154:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7381684a00, rc 0) 00000100:00100000:1.0:1788638378.982546:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:5840:x1875523183583488:12345-0@lo:101: Request processed in 508us (5003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638378.982554:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788638378.982970:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183583488:0@lo:101: 00010000:00010000:0.0:1788638378.982994:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a668 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a66f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638378.983006:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a668 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a66f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638378.983090:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183583616:0@lo:501: 00000100:00100000:0.0:1788638378.983138:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638378.983480:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bf2ad480 going to sleep for 11 seconds 00000100:00100000:1.0:1788638378.983668:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183583616 00000100:00100000:1.0:1788638378.983676:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183583616 00000100:00100000:1.0:1788638378.983763:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788638378.983774:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:5840:x1875523183583616:12345-0@lo:501: 00000100:00100000:1.0:1788638378.984296:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:5840:x1875523183583616:12345-0@lo:501: Request processed in 522us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638378.984305:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788638378.988418:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183583616:0@lo:501: 00000100:00100000:3.0:1788638378.988518:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183583744:0@lo:503: 00000100:00100000:3.0:1788638378.988620:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638378.988689:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398237180 going to sleep for 11 seconds 00000100:00100000:1.0:1788638378.990156:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183583744 00000100:00100000:1.0:1788638378.990172:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183583744 00000100:00100000:1.0:1788638378.990257:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788638378.990268:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:5840:x1875523183583744:12345-0@lo:503: 00000100:00100000:1.0:1788638378.992000:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:5840:x1875523183583744:12345-0@lo:503: Request processed in 1723us (3369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638378.992027:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788638379.001200:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183583744:0@lo:503: 00000100:00100000:1.0:1788638379.001975:0:6780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6780:1875523183583872:0@lo:502: 00000100:00100000:1.0:1788638379.002083:0:6780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638379.002267:0:6780:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d8e900 going to sleep for 11 seconds 00000100:00100000:3.0:1788638379.002337:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183583872 00000100:00100000:3.0:1788638379.002345:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183583872 00000100:00100000:3.0:1788638379.002409:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788638379.002420:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:6780:x1875523183583872:12345-0@lo:502: 00000100:00100000:3.0:1788638379.002844:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:6780:x1875523183583872:12345-0@lo:502: Request processed in 425us (760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638379.002853:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788638379.003370:0:6780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6780:1875523183583872:0@lo:502: 00000100:00100000:1.0:1788638379.003458:0:6780:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6780:1875523183584000:0@lo:502: 00000100:00100000:1.0:1788638379.003516:0:6780:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638379.003574:0:6780:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d8e900 going to sleep for 11 seconds 00000100:00100000:0.0:1788638379.003645:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183584000 00000100:00100000:0.0:1788638379.003654:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183584000 00000100:00100000:0.0:1788638379.003695:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788638379.003702:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:6780:x1875523183584000:12345-0@lo:502: 00000100:00100000:0.0:1788638379.003943:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:6780:x1875523183584000:12345-0@lo:502: Request processed in 239us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638379.003950:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788638379.004132:0:6780:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6780:1875523183584000:0@lo:502: 00000040:00080000:1.0:1788638379.004154:0:6780:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788638379.004410:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788638379.004431:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788638379.004451:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a668 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a66f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638379.004463:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a66f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638379.004476:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788638379.004479:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7387a11800 from 4 10000000:01000000:0.0:1788638379.004482:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788638379.004518:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a676 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638379.004527:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a676 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638379.004537:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a676 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638379.004552:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183584128:0@lo:101: 00000100:00100000:0.0:1788638379.004589:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638379.004631:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bf2ad840 going to sleep for 11 seconds 00000100:00100000:3.0:1788638379.004697:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183584128 00000100:00100000:3.0:1788638379.004703:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183584128 00000100:00100000:3.0:1788638379.004820:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788638379.004829:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:5840:x1875523183584128:12345-0@lo:101: 00010000:00010000:3.0:1788638379.004840:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638379.004857:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73829f0600/0xa0b1f1e3b4b2a67d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a676 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638379.004881:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73829f0600/0xa0b1f1e3b4b2a67d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a676 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638379.004894:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73829f0600/0xa0b1f1e3b4b2a67d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a676 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638379.004903:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73829f0600, rc 0) 00000100:00100000:3.0:1788638379.004940:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:5840:x1875523183584128:12345-0@lo:101: Request processed in 113us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638379.004946:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788638379.009360:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183584128:0@lo:101: 00010000:00010000:2.0:1788638379.009399:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a676 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a67d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638379.009414:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a676 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a67d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638379.009528:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183584256:0@lo:256: 00000100:00100000:2.0:1788638379.009618:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638379.009674:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398134840 going to sleep for 11 seconds 00000100:00100000:0.0:1788638379.009813:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183584256 00000100:00100000:0.0:1788638379.009822:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183584256 00000100:00100000:0.0:1788638379.009879:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788638379.009890:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:5840:x1875523183584256:12345-0@lo:256: 20000000:01000000:0.0:1788638379.009914:0:5837:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788638379.009932:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788638379.009936:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1788638379.010052:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:5840:x1875523183584256:12345-0@lo:256: Request processed in 162us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638379.010061:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788638379.010334:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183584256:0@lo:256: 10000000:01000000:2.0:1788638379.010388:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788638379.010397:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a676 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a67d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638379.010418:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a67d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638379.010446:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788638379.010449:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788638379.010453:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788638379.010484:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a684 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638379.010493:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a684 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638379.010503:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a684 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638379.010519:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183584384:0@lo:101: 00000100:00100000:2.0:1788638379.010551:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638379.010574:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398134840 going to sleep for 11 seconds 00000100:00100000:0.0:1788638379.010708:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183584384 00000100:00100000:0.0:1788638379.010714:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183584384 00000100:00100000:0.0:1788638379.010811:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788638379.010821:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:5840:x1875523183584384:12345-0@lo:101: 00010000:00010000:0.0:1788638379.010833:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638379.010848:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2a68b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a684 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638379.010872:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2a68b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a684 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638379.010884:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2a68b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a684 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638379.010894:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031e00, rc 0) 00000100:00100000:0.0:1788638379.010929:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:5840:x1875523183584384:12345-0@lo:101: Request processed in 110us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638379.010936:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788638379.011040:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183584384:0@lo:101: 00010000:00010000:2.0:1788638379.011053:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a684 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a68b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638379.011061:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a684 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a68b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638379.011241:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183584512:0@lo:501: 00000100:00100000:2.0:1788638379.011268:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638379.011294:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398134840 going to sleep for 11 seconds 00000100:00100000:0.0:1788638379.011346:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183584512 00000100:00100000:0.0:1788638379.011351:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183584512 00000100:00100000:0.0:1788638379.011370:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788638379.011376:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:5840:x1875523183584512:12345-0@lo:501: 00000100:00100000:0.0:1788638379.011669:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:5840:x1875523183584512:12345-0@lo:501: Request processed in 292us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638379.011676:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788638379.011823:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183584512:0@lo:501: 00000100:00100000:2.0:1788638379.011857:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183584640:0@lo:503: 00000100:00100000:2.0:1788638379.011902:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638379.011923:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398134840 going to sleep for 11 seconds 00000100:00100000:3.0:1788638379.011986:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183584640 00000100:00100000:3.0:1788638379.011999:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183584640 00000100:00100000:3.0:1788638379.012420:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788638379.012609:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:5840:x1875523183584640:12345-0@lo:503: 00000100:00100000:3.0:1788638379.013390:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:5840:x1875523183584640:12345-0@lo:503: Request processed in 783us (1484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638379.013400:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788638379.013772:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183584640:0@lo:503: 00000100:00100000:2.0:1788638379.016263:0:6781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6781:1875523183584768:0@lo:502: 00000100:00100000:2.0:1788638379.016378:0:6781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638379.016427:0:6781:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398134f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788638379.016454:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183584768 00000100:00100000:0.0:1788638379.016463:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183584768 00000100:00100000:0.0:1788638379.016516:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788638379.016526:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:6781:x1875523183584768:12345-0@lo:502: 00000100:00100000:0.0:1788638379.016892:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:6781:x1875523183584768:12345-0@lo:502: Request processed in 365us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638379.016901:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788638379.017016:0:6781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6781:1875523183584768:0@lo:502: 00000020:01000000:2.0:1788638379.017053:0:6781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788638379.017063:0:6781:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788638379.017072:0:6781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638379.017075:0:6781:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788638379.017086:0:6781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788638379.017089:0:6781:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.134@tcp to nid 0x20000c0a8cb86 (192.168.203.134@tcp) 00000020:01000000:2.0:1788638379.017114:0:6781:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788638379.017117:0:6781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788638379.017149:0:6781:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c7385324d40) 00000020:00000080:2.0:1788638379.017176:0:6781:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788638379.017190:0:6781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788638379.017280:0:6781:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788638379.017287:0:6781:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788638379.017295:0:6781:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa0b1f1e3b4b2a699 00010000:00080000:2.0:1788638379.017335:0:6781:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c73bc023800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.134@tcp at head 00010000:00010000:2.0:1788638379.017624:0:6781:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788638379.063573:0:6781:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788638379.063603:0:6781:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788638379.065243:0:6781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788638379.065462:0:6781:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788638379.065519:0:6781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788638379.065584:0:6781:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1788638379.066409:0:6783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788638379.066415:0:6783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788638379.067338:0:6781:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788638379.067356:0:6781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788638379.067395:0:6781:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788638379.067421:0:6781:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa0b1f1e3b4b2a6a0 00000100:00080000:3.0:1788638379.067445:0:6781:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788638379.067452:0:6781:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c73bc023800 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:3.0:1788638379.067497:0:6781:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73acdcbb80 x1875523183584896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788638379.067526:0:6781:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788638379.067602:0:6781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638379.067606:0:6781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638379.067608:0:6781:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788638379.067611:0:6781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788638379.067616:0:6781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638379.067617:0:6781:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788638379.067620:0:6781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788638379.067622:0:6781:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788638379.067653:0:6781:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6781:1875523183585024:0@lo:502: 00000100:00100000:3.0:1788638379.067758:0:6781:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638379.067839:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183585024 00000100:00100000:3.0:1788638379.067847:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183585024 00000100:00100000:3.0:1788638379.067894:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788638379.067903:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:6781:x1875523183585024:12345-0@lo:502: 00000100:00100000:0.0:1788638379.068653:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183585152:0@lo:400: 00000100:00100000:0.0:1788638379.068712:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638379.068765:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788638379.068771:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183585280:0@lo:400: 00000100:00100000:0.0:1788638379.068816:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638379.068858:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183585152 00000100:00100000:0.0:1788638379.068865:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183585152 00000100:00100000:0.0:1788638379.068901:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183585280 00000100:00100000:0.0:1788638379.068905:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183585280 00000100:00100000:0.0:1788638379.068933:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788638379.068940:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183585152:12345-0@lo:400: 00000100:00100000:0.0:1788638379.068991:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183585152:12345-0@lo:400: Request processed in 50us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638379.068998:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788638379.069041:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788638379.069048:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183585280:12345-0@lo:400: 00000100:00100000:0.0:1788638379.069175:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183585280:12345-0@lo:400: Request processed in 127us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638379.069181:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788638379.069206:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788638379.069353:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73837a6680 x1875523183585280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638379.069369:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183585280:0@lo:400: 00010000:00080000:0.0:1788638379.069379:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73837a7480 x1875523183585152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638395 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638379.069388:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183585152:0@lo:400: 00000100:00100000:2.0:1788638379.070344:0:6781:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398237900 going to sleep for 11 seconds 00000100:00100000:2.0:1788638379.070371:0:6781:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6781:1875523183585024:0@lo:502: 00000100:00100000:3.0:1788638379.070509:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:6781:x1875523183585024:12345-0@lo:502: Request processed in 2605us (2749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638379.070520:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000020:01000000:2.0:1788638379.070686:0:6781:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788638379.070695:0:6781:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638379.070698:0:6781:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788638379.070708:0:6781:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:1.0:1788638379.070952:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183584896:0@lo:8: 00000100:00100000:1.0:1788638379.071021:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638379.071252:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183584896 00000100:00100000:0.0:1788638379.071259:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183584896 00000100:00100000:0.0:1788638379.071294:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788638379.071301:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3290:x1875523183584896:12345-0@lo:8: 00010000:00080000:0.0:1788638379.071331:0:6684:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 142 last 0 00000020:00000080:0.0:1788638379.071364:0:6684:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa0b1f1e3b4b2a6a7 00002000:00100000:0.0:1788638379.071412:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c73aeffd000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788638379.071417:0:6684:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1788638379.071421:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788638379.071552:0:6684:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788638379.071727:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788638379.071756:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9c73aeff9800 : changing import state from RECOVER to FULL 00000020:01000000:1.0:1788638379.071842:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788638379.071864:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788638379.071875:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a684 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a68b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638379.071887:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a68b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638379.071897:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788638379.071901:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7387a11800 from 1 10000000:01000000:1.0:1788638379.071903:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788638379.071937:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7381684600/0xa0b1f1e3b4b2a6ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638379.071944:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7381684600/0xa0b1f1e3b4b2a6ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638379.071953:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7381684600/0xa0b1f1e3b4b2a6ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638379.071978:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183585408:0@lo:101: 00000100:00100000:1.0:1788638379.072034:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638379.072183:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d8e240 going to sleep for 11 seconds 00000100:00100000:3.0:1788638379.072294:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183585408 00000100:00100000:3.0:1788638379.072300:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183585408 00000100:00100000:3.0:1788638379.072347:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788638379.072356:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:5840:x1875523183585408:12345-0@lo:101: 00010000:00010000:3.0:1788638379.072366:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638379.072381:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73829f1c00/0xa0b1f1e3b4b2a6b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a6ae expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638379.072407:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73829f1c00/0xa0b1f1e3b4b2a6b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a6ae expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638379.072418:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73829f1c00/0xa0b1f1e3b4b2a6b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a6ae expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638379.072428:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73829f1c00, rc 0) 00000100:00100000:3.0:1788638379.072475:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:5840:x1875523183585408:12345-0@lo:101: Request processed in 121us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638379.072482:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788638379.072522:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183585408:0@lo:101: 00010000:00010000:3.0:1788638379.072536:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7381684600/0xa0b1f1e3b4b2a6ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a6b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638379.072545:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7381684600/0xa0b1f1e3b4b2a6ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a6b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638379.072608:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183585536:0@lo:501: 00000100:00100000:3.0:1788638379.072634:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638379.072647:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73982376c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638379.072660:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183585536 00000100:00100000:3.0:1788638379.072663:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183585536 00000100:00100000:3.0:1788638379.072685:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788638379.072691:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:5840:x1875523183585536:12345-0@lo:501: 00000100:00100000:3.0:1788638379.072955:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:5840:x1875523183585536:12345-0@lo:501: Request processed in 263us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638379.072962:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788638379.072993:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183585536:0@lo:501: 00000100:00100000:0.0:1788638379.073669:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3290:x1875523183584896:12345-0@lo:8: Request processed in 2363us (2643us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638379.073687:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788638379.073751:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73acdcbb80 x1875523183584896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788638389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638379.073763:0:3290:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788638379.073772:0:3290:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788638379.073799:0:3290:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788638379.073805:0:3290:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788638379.073809:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73bc023800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788638379.073824:0:3290:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788638379.073832:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183584896:0@lo:8: 00000004:00080000:2.0:1788638379.074265:0:6783:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788638379.074416:0:6783:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 142145632398ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788638379.074864:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183585664:0@lo:503: 00000100:00100000:3.0:1788638379.074945:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638379.074989:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73982376c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638379.075554:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183585664 00000100:00100000:2.0:1788638379.075564:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183585664 00000100:00100000:2.0:1788638379.075621:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788638379.075631:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:5840:x1875523183585664:12345-0@lo:503: 00000100:00100000:2.0:1788638379.076042:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:5840:x1875523183585664:12345-0@lo:503: Request processed in 411us (1095us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638379.076051:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788638379.076084:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdca680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183585664:0@lo:503: 00000100:00100000:0.0:1788638379.076955:0:6785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6785:1875523183585792:0@lo:502: 00000100:00100000:0.0:1788638379.077030:0:6785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638379.077075:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183585792 00000100:00100000:0.0:1788638379.077080:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183585792 00000100:00100000:0.0:1788638379.077124:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788638379.077133:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:6785:x1875523183585792:12345-0@lo:502: 00000100:00100000:0.0:1788638379.077321:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:6785:x1875523183585792:12345-0@lo:502: Request processed in 188us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638379.077329:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788638379.077380:0:6785:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bf2ad9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638379.077399:0:6785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6785:1875523183585792:0@lo:502: 00000020:01000000:0.0:1788638379.077425:0:6785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788638379.077450:0:6785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638379.077454:0:6785:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788638379.077463:0:6785:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7387a11800 00000020:00000080:0.0:1788638379.077465:0:6785:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788638379.077495:0:6785:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6785:1875523183585920:0@lo:502: 00000100:00100000:0.0:1788638379.077528:0:6785:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638379.077548:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183585920 00000100:00100000:0.0:1788638379.077551:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183585920 00000100:00100000:0.0:1788638379.077571:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788638379.077577:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:6785:x1875523183585920:12345-0@lo:502: 00000100:00100000:0.0:1788638379.077676:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:6785:x1875523183585920:12345-0@lo:502: Request processed in 99us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638379.077683:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788638379.077711:0:6785:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bf2ad9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638379.077723:0:6785:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:6785:1875523183585920:0@lo:502: 00000020:01000000:0.0:1788638379.077740:0:6785:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638379.077745:0:6785:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638379.077746:0:6785:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788638379.077749:0:6785:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1788638379.077829:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788638379.077847:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788638379.077858:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7381684600/0xa0b1f1e3b4b2a6ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a6b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638379.077869:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7381684600/0xa0b1f1e3b4b2a6ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a6b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638379.077878:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788638379.077881:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c738375b380 from 1 10000000:01000000:0.0:1788638379.077884:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788638379.077912:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a6bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638379.077921:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a6bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638379.077938:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a6bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638379.077951:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183586048:0@lo:101: 00000100:00100000:0.0:1788638379.077977:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638379.077990:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73879730c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638379.078007:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183586048 00000100:00100000:0.0:1788638379.078010:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183586048 00000100:00100000:0.0:1788638379.078032:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788638379.078038:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:5840:x1875523183586048:12345-0@lo:101: 00010000:00010000:0.0:1788638379.078047:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638379.078062:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7380030c00/0xa0b1f1e3b4b2a6c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a6bc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638379.078088:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7380030c00/0xa0b1f1e3b4b2a6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a6bc expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638379.078099:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7380030c00/0xa0b1f1e3b4b2a6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a6bc expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638379.078109:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030c00, rc 0) 00000100:00100000:0.0:1788638379.078137:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:5840:x1875523183586048:12345-0@lo:101: Request processed in 99us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638379.078143:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788638379.078172:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183586048:0@lo:101: 00010000:00010000:0.0:1788638379.078186:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a6bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a6c3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638379.078207:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a6bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a6c3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638379.078249:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183586176:0@lo:501: 00000100:00100000:0.0:1788638379.078274:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638379.078287:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bf2ad540 going to sleep for 11 seconds 00000100:00100000:0.0:1788638379.078299:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183586176 00000100:00100000:0.0:1788638379.078301:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183586176 00000100:00100000:0.0:1788638379.078320:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788638379.078326:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:5840:x1875523183586176:12345-0@lo:501: 00000100:00100000:0.0:1788638379.078515:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:5840:x1875523183586176:12345-0@lo:501: Request processed in 188us (239us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788638379.078523:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788638379.078554:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183586176:0@lo:501: 10000000:01000000:0.0:1788638379.078572:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788638379.078578:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a6bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a6c3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638379.078586:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a6c3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788638379.157476:0:6784:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788638379.157518:0:6784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1875523183586432:0@lo:7: 00000100:00100000:0.0:1788638379.157606:0:6784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638379.157673:0:6784:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73915f9240 going to sleep for 11 seconds 00000100:00100000:0.0:1788638379.157736:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183586304:0@lo:13: 00000100:00100000:0.0:1788638379.157779:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638379.157866:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183586432 00000100:00100000:0.0:1788638379.157876:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183586432 00000100:00100000:0.0:1788638379.157946:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638379.157956:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6784:x1875523183586432:12345-0@lo:7: 00000100:00100000:3.0:1788638379.161719:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183586304 00000100:00100000:3.0:1788638379.161740:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183586304 00000100:00100000:3.0:1788638379.161856:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638379.161870:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1875523183586304:12345-0@lo:13: 00002000:00000024:3.0:1788638379.161912:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788638379.162036:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1875523183586304:12345-0@lo:13: Request processed in 169us (4255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638379.162043:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788638379.163068:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788638379.165002:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73837a7480 x1875523183586304/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638379.165035:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183586304:0@lo:13: 00002000:00080000:0.0:1788638379.181304:0:6687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788638379.181315:0:6687:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788638379.181472:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6784:x1875523183586432:12345-0@lo:7: Request processed in 23509us (23858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638379.181483:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788638379.181560:0:6784:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73837a6680 x1875523183586432/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788638395 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638379.181578:0:6784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1875523183586432:0@lo:7: 00000004:00080000:0.0:1788638379.181598:0:6784:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788638379.181650:0:6784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1875523183586560:0@lo:5: 00000100:00100000:0.0:1788638379.181692:0:6784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638379.181743:0:6784:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bf2ad180 going to sleep for 11 seconds 00000100:00100000:0.0:1788638379.181768:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183586560 00000100:00100000:0.0:1788638379.181775:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183586560 00000100:00100000:0.0:1788638379.181853:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788638379.181863:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6784:x1875523183586560:12345-0@lo:5: 00002000:00080000:0.0:1788638379.181896:0:6684:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788638379.181910:0:6684:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788638379.186552:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6784:x1875523183586560:12345-0@lo:5: Request processed in 4676us (4845us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788638379.186569:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788638379.188751:0:6784:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73837a6680 x1875523183586560/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788638395 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638379.188857:0:6784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1875523183586560:0@lo:5: 00000004:00080000:1.0:1788638379.188879:0:6784:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788638379.188935:0:6784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1875523183586688:0@lo:700: 00000100:00100000:1.0:1788638379.189013:0:6784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638379.189581:0:6784:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d8ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788638379.191928:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183586688 00000100:00100000:2.0:1788638379.191948:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183586688 00000100:00100000:2.0:1788638379.192024:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788638379.192036:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6784:x1875523183586688:12345-0@lo:700: 00000100:00100000:2.0:1788638379.192117:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6693:1875523183586816:0@lo:700: 00000100:00100000:2.0:1788638379.192204:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638379.192244:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387969600 going to sleep for 11 seconds 00000100:00100000:0.0:1788638379.199953:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183586816 00000100:00100000:0.0:1788638379.199974:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183586816 00000100:00100000:0.0:1788638379.200048:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788638379.200059:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6693:x1875523183586816:12345-0@lo:700: 00000004:00080000:1.0:1788638379.223858:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:1.0:1788638379.308339:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1788638379.321315:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6693:x1875523183586816:12345-0@lo:700: Request processed in 121246us (129099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638379.321341:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788638379.321569:0:6693:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73837d6a00 x1875523183586816/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788638395 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638379.321593:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6693:1875523183586816:0@lo:700: 40000000:02000000:2.0:1788638379.321610:0:6693:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:3.0:1788638379.418937:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6784:x1875523183586688:12345-0@lo:700: Request processed in 226890us (229909us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638379.418968:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:3.0:1788638379.419010:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788638379.419023:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1788638379.419835:0:6784:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73ad30c000 x1875523183586688/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788638395 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638379.419856:0:6784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30c000 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1875523183586688:0@lo:700: 00000004:02000040:1.0:1788638379.485448:0:6784:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1788638379.496709:0:6784:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1875523183586944:0@lo:5: 00000100:00100000:2.0:1788638379.503330:0:6784:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638379.503399:0:6784:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387969600 going to sleep for 11 seconds 00000100:00100000:1.0:1788638379.503519:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183586944 00000100:00100000:1.0:1788638379.503531:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183586944 00000100:00100000:1.0:1788638379.503675:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788638379.503686:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6784:x1875523183586944:12345-0@lo:5: 00002000:00080000:3.0:1788638379.519584:0:6687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788638379.519996:0:6687:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1788638379.538256:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6784:x1875523183586944:12345-0@lo:5: Request processed in 34558us (34923us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788638379.538281:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788638379.541987:0:6784:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73837d6a00 x1875523183586944/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788638395 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638379.542026:0:6784:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788638379.542047:0:6784:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c73837d6a00 x1875523183586944/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788638395 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638379.542062:0:6784:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1875523183586944:0@lo:5: 00000004:00080000:1.0:1788638379.542082:0:6784:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1788638379.872094:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638380.897234:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638381.921304:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638382.944297:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788638383.650965:0:7056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg334-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788638383.969008:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638384.367646:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183587200:0@lo:400: 00000100:00100000:3.0:1788638384.367722:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638384.367776:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788638384.367805:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183587328:0@lo:400: 00000100:00100000:3.0:1788638384.367835:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638384.371980:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183587072:0@lo:13: 00000100:00100000:0.0:1788638384.372089:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638384.372156:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183587584:0@lo:400: 00000100:00100000:0.0:1788638384.374653:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638384.374750:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788638384.374765:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183587456:0@lo:400: 00000100:00100000:0.0:1788638384.374853:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638384.374901:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183587200 00000100:00100000:0.0:1788638384.374911:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183587200 00000100:00100000:0.0:1788638384.374977:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788638384.374988:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:3293:x1875523183587200:12345-0@lo:400: 00000100:00100000:0.0:1788638384.375065:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:3293:x1875523183587200:12345-0@lo:400: Request processed in 79us (7342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638384.375073:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788638384.375123:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183587328 00000100:00100000:0.0:1788638384.375128:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183587328 00000100:00100000:0.0:1788638384.375159:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183587456 00000100:00100000:0.0:1788638384.375161:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183587456 00000100:00100000:0.0:1788638384.375205:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788638384.375216:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183587328:12345-0@lo:400: 00000100:00100000:0.0:1788638384.375271:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183587328:12345-0@lo:400: Request processed in 57us (7434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638384.375278:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788638384.375291:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788638384.375298:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183587456:12345-0@lo:400: 00000100:00100000:0.0:1788638384.375331:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183587456:12345-0@lo:400: Request processed in 34us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638384.375337:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788638384.375374:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183587072 00000100:00100000:0.0:1788638384.375379:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183587072 00000100:00100000:0.0:1788638384.375421:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638384.375428:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1875523183587072:12345-0@lo:13: 00002000:00000024:0.0:1788638384.375459:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638384.375494:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1875523183587072:12345-0@lo:13: Request processed in 67us (3407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638384.375499:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638384.375534:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183587584 00000100:00100000:0.0:1788638384.375538:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183587584 00000100:00100000:0.0:1788638384.375567:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788638384.375573:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3292:x1875523183587584:12345-0@lo:400: 00000100:00100000:0.0:1788638384.375606:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3292:x1875523183587584:12345-0@lo:400: Request processed in 33us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638384.375613:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788638384.375667:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73acdc8a80 x1875523183587328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638384.375685:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183587328:0@lo:400: 00000100:00100000:0.0:1788638384.375708:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183587200:0@lo:400: 00000100:00080000:0.0:1788638384.375746:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788638384.375755:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788638384.375778:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73acdcbb80 x1875523183587456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638384.375820:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183587456:0@lo:400: 00010000:00080000:0.0:1788638384.375833:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73ad30c000 x1875523183587072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638384.375848:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183587072:0@lo:13: 00010000:00080000:0.0:1788638384.375859:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73acdc9180 x1875523183587584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638384.375870:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183587584:0@lo:400: 00000001:00080000:2.0:1788638384.473260:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1788638384.992392:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638386.016188:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638387.040009:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638388.073586:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638389.088103:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638389.472126:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788638389.473269:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183587968:0@lo:400: 00000100:00100000:2.0:1788638389.473348:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638389.473421:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788638389.473428:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183588096:0@lo:400: 00000100:00100000:2.0:1788638389.473452:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638389.476044:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183587840:0@lo:13: 00000100:00100000:1.0:1788638389.476126:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638389.476288:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183587712:0@lo:400: 00000100:00100000:1.0:1788638389.476337:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638389.476384:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788638389.476392:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183588224:0@lo:400: 00000100:00100000:1.0:1788638389.476416:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638389.476800:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183587968 00000100:00100000:0.0:1788638389.476810:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183587968 00000100:00100000:3.0:1788638389.476850:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183588224 00000100:00100000:3.0:1788638389.476854:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183588224 00000100:00100000:0.0:1788638389.476874:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183588096 00000100:00100000:0.0:1788638389.476877:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183588096 00000100:00100000:3.0:1788638389.476894:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638389.476894:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788638389.476902:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183588224:12345-0@lo:400: 00000100:00100000:0.0:1788638389.476902:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183587968:12345-0@lo:400: 00000100:00100000:3.0:1788638389.476959:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183588224:12345-0@lo:400: Request processed in 57us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638389.476966:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183587968:12345-0@lo:400: Request processed in 66us (3619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638389.476967:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638389.476972:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788638389.476988:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788638389.476993:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788638389.477034:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73acdcb480 x1875523183587968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638389.477061:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788638389.477068:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183588096:12345-0@lo:400: 00000100:00100000:3.0:1788638389.477070:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183587968:0@lo:400: 00000100:00100000:0.0:1788638389.477126:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183588096:12345-0@lo:400: Request processed in 58us (3672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638389.477142:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1788638389.477147:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73acdc8e00 x1875523183588224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638389.477157:0:3294:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788638389.477176:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183587712 00000100:00100000:0.0:1788638389.477181:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183587712 00000100:00100000:0.0:1788638389.477205:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788638389.477211:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:3294:x1875523183587712:12345-0@lo:400: 00000100:00100000:0.0:1788638389.477242:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:3294:x1875523183587712:12345-0@lo:400: Request processed in 31us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638389.477247:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183588224:0@lo:400: 00000100:00100000:0.0:1788638389.477248:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788638389.477258:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183587712:0@lo:400: 00010000:00080000:3.0:1788638389.477329:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73acdcad80 x1875523183588096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638389.477348:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183588096:0@lo:400: 00000100:00100000:2.0:1788638389.477535:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183587840 00000100:00100000:2.0:1788638389.477540:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183587840 00000100:00100000:2.0:1788638389.477569:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788638389.477575:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183587840:12345-0@lo:13: 00002000:00000024:2.0:1788638389.477608:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788638389.477843:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183587840:12345-0@lo:13: Request processed in 267us (1717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638389.477850:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788638389.477937:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73837a5f80 x1875523183587840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638389.477968:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183587840:0@lo:13: 00010000:00010000:3.0:1788638390.113137:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638391.136016:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638392.160451:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638393.191088:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638394.208476:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638394.591943:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183588352:0@lo:13: 00000100:00100000:1.0:1788638394.592023:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638394.592649:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183588352 00000100:00100000:0.0:1788638394.592658:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183588352 00000100:00100000:0.0:1788638394.592722:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788638394.592733:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183588352:12345-0@lo:13: 00002000:00000024:0.0:1788638394.592771:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638394.592850:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183588352:12345-0@lo:13: Request processed in 118us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638394.592857:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788638394.592916:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73ad30ce00 x1875523183588352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638394.592937:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183588352:0@lo:13: 00000100:00080000:3.0:1788638394.593000:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788638394.593259:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183588480:0@lo:400: 00000100:00100000:3.0:1788638394.593310:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638394.593380:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183588480 00000100:00100000:0.0:1788638394.593385:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183588480 00000100:00100000:0.0:1788638394.593414:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788638394.593421:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:3291:x1875523183588480:12345-0@lo:400: 00000100:00100000:0.0:1788638394.605718:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:3291:x1875523183588480:12345-0@lo:400: Request processed in 12287us (12397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638394.605749:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788638394.614833:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183588480:0@lo:400: 00000100:00100000:3.0:1788638394.614867:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788638394.614880:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183588608:0@lo:400: 00000100:00100000:3.0:1788638394.614986:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638394.618510:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183588736:0@lo:400: 00000100:00100000:1.0:1788638394.618577:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:2.0:1788638394.626419:0:7632:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788638394.626424:0:7632:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788638394.626571:0:7632:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c73b4c0d800 00000020:01000004:2.0:1788638394.626588:0:7632:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788638394.626602:0:7632:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788638394.626615:0:7632:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c73853219c0) 00000020:00000080:2.0:1788638394.626632:0:7632:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00000100:00100000:0.0:1788638394.632224:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183588608 00000100:00100000:0.0:1788638394.632239:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183588608 00000100:00100000:0.0:1788638394.632388:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183588736 00000100:00100000:0.0:1788638394.632394:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183588736 00000100:00100000:0.0:1788638394.632432:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788638394.632442:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183588608:12345-0@lo:400: 00000100:00100000:1.0:1788638394.632707:0:5844:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788638394.632718:0:5844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:1.0:1788638394.632857:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73ad30ca80 x1875523183588608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638394.632874:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183588608:0@lo:400: 00000100:00100000:0.0:1788638394.634244:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183588608:12345-0@lo:400: Request processed in 1794us (19269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638394.634259:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788638394.634301:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788638394.634315:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183588736:12345-0@lo:400: 00000100:00100000:0.0:1788638394.634405:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183588736:12345-0@lo:400: Request processed in 96us (15827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638394.634412:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788638394.634586:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73ad30f100 x1875523183588736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638410 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638394.634601:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183588736:0@lo:400: 00000100:00080000:3.0:1788638394.634811:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00100000:10000000:2.0:1788638394.663954:0:7632:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788638394.664707:0:7632:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788638394.692942:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788638394.699468:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788638394.699509:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788638394.699570:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788638394.699600:0:7632:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788638394.699997:0:7632:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788638394.700010:0:7632:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788638394.700020:0:7632:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa0b1f1e3b4b2a6d1 00000020:01000004:3.0:1788638394.700029:0:7632:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788638394.700051:0:7632:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.134@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788638394.700189:0:7632:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788638394.700267:0:7632:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788638394.700368:0:7632:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788638394.700374:0:7632:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.134@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788638394.742014:0:7632:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.134@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788638394.742216:0:7632:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.134@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1788638394.742221:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788638394.742223:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788638394.742224:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788638394.742225:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788638394.742226:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788638394.742227:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788638394.742229:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788638394.742230:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788638394.742231:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788638394.742233:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788638394.742234:0:7632:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788638394.742237:0:7632:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1788638394.742239:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788638394.742240:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788638394.742241:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788638394.742242:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788638394.742243:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788638394.742244:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788638394.742245:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788638394.742246:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788638394.742247:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788638394.742248:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788638394.742248:0:7632:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788638394.742277:0:7632:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788638394.742367:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183588864:0@lo:253: 00000100:00100000:2.0:1788638394.742444:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638394.742559:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387cf1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638394.744703:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183588864 00000100:00100000:0.0:1788638394.744717:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183588864 00000100:00100000:0.0:1788638394.744864:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788638394.744875:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:7632:x1875523183588864:12345-0@lo:253: 20000000:01000000:0.0:1788638394.744911:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788638394.744916:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788638394.744922:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788638394.744925:0:5837:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788638394.759876:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788638394.760459:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1788638394.760475:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788638394.760521:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1788638394.760529:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788638394.761727:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1788638394.761852:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1788638394.764191:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1788638394.764222:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.134@tcp 20000000:01000000:1.0:1788638394.764224:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.134@tcp (null) (null) (null) 00000040:00080000:1.0:1788638394.764262:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1788638394.764279:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788638394.765997:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1788638394.766019:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.134@tcp (null) (null) 00000040:00080000:1.0:1788638394.766071:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1788638394.766081:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788638394.766114:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1788638394.767197:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1788638394.770420:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1788638394.770452:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.134@tcp 20000000:01000000:1.0:1788638394.770455:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.134@tcp (null) (null) (null) 00000040:00080000:1.0:1788638394.770496:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1788638394.770504:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788638394.770547:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1788638394.770555:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.134@tcp (null) (null) 00000040:00080000:1.0:1788638394.771393:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1788638394.771410:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788638394.771477:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1788638394.771518:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1788638394.771766:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1788638394.771770:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1788638394.771776:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788638394.771777:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788638394.771909:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788638394.771926:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788638394.771929:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788638394.771981:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788638394.771984:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788638394.773271:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788638394.773467:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788638394.773527:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1788638394.774437:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1788638394.774486:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1788638394.774522:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1788638394.774660:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788638394.774664:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788638394.778687:0:7636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788638394.778972:0:7636:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788638394.779020:0:7636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:0.0:1788638394.780426:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:0.0:1788638394.780486:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:0.0:1788638394.780683:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:0.0:1788638394.780704:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788638394.780706:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788638394.784180:0:7637:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1788638394.785240:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1788638394.785456:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1788638394.788181:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1788638394.788217:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788638394.788221:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788638394.789200:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1788638394.789272:0:7638:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1788638394.789435:0:7638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1788638394.789778:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1788638394.794248:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1788638394.794482:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 10000000:01000000:1.0:1788638394.794507:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788638394.794528:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a6d8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.794557:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a61b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a614 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.794565:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7381685a00/0xa0b1f1e3b4b2a645 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a63e expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.794573:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a66f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a668 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.794645:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2a68b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a684 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.794652:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7380030c00/0xa0b1f1e3b4b2a6c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a6bc expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.794660:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a6d8 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.794724:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7380030c00/0xa0b1f1e3b4b2a6c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a6bc expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.794739:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7380030c00/0xa0b1f1e3b4b2a6c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a6bc expref: 16 pid: 5835 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638394.794754:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875523183588992:0@lo:104: 00000100:00100000:1.0:1788638394.794944:0:5837:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788638394.795039:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2a68b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a684 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.795048:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2a68b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a684 expref: 16 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638394.795188:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875523183589120:0@lo:104: 00010000:00010000:1.0:1788638394.795218:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a66f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a668 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.795226:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a66f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a668 expref: 16 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638394.795233:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875523183589248:0@lo:104: 00010000:00010000:1.0:1788638394.795255:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7381685a00/0xa0b1f1e3b4b2a645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a63e expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.795263:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7381685a00/0xa0b1f1e3b4b2a645 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a63e expref: 16 pid: 5835 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638394.795270:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875523183589376:0@lo:104: 00010000:00010000:1.0:1788638394.795435:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a61b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a614 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.795443:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a61b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a614 expref: 16 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638394.795452:0:5837:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875523183589504:0@lo:104: 00000100:00100000:1.0:1788638394.795470:0:5837:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7386665d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788638394.797763:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788638394.797833:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638394.797869:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638394.797880:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638394.797891:0:5825:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638394.797905:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183588992 00000100:00100000:0.0:1788638394.797912:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183588992 00000100:00100000:0.0:1788638394.797951:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183589120 00000100:00100000:0.0:1788638394.797953:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183589120 00000100:00100000:0.0:1788638394.797963:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183589248 00000100:00100000:0.0:1788638394.797965:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183589248 00000100:00100000:0.0:1788638394.797974:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183589376 00000100:00100000:0.0:1788638394.797976:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183589376 00000100:00100000:0.0:1788638394.797985:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183589504 00000100:00100000:0.0:1788638394.797988:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183589504 00000100:00100000:0.0:1788638394.797999:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788638394.798009:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d47050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+7:5837:x1875523183588992:12345-0@lo:104: 00010000:00010000:0.0:1788638394.798026:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a6c3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.798286:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788638394.798438:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d47050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+7:5837:x1875523183588992:12345-0@lo:104: Request processed in 430us (3493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638394.798446:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788638394.798491:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788638394.798498:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+6:5837:x1875523183589120:12345-0@lo:104: 00010000:00010000:0.0:1788638394.798505:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a68b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.798656:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788638394.798675:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+6:5837:x1875523183589120:12345-0@lo:104: Request processed in 177us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638394.798681:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788638394.798695:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788638394.798700:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+5:5837:x1875523183589248:12345-0@lo:104: 00010000:00010000:0.0:1788638394.798709:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a66f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.798741:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788638394.798745:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+5:5837:x1875523183589248:12345-0@lo:104: Request processed in 46us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638394.798750:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788638394.798761:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788638394.798766:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+4:5837:x1875523183589376:12345-0@lo:104: 00010000:00010000:0.0:1788638394.798772:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a63e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a645 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.798824:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788638394.798830:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+4:5837:x1875523183589376:12345-0@lo:104: Request processed in 64us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638394.798835:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788638394.798846:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788638394.798852:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:5837:x1875523183589504:12345-0@lo:104: 00010000:00010000:0.0:1788638394.798859:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2a614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a61b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.798883:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788638394.798894:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:5837:x1875523183589504:12345-0@lo:104: Request processed in 42us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638394.798899:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788638394.798916:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788638394.798921:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a6c3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.798927:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030400 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:0.0:1788638394.798931:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a6bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a6c3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.798940:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a6bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a6c3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638394.798946:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a6bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a6c3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638394.798951:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788638394.798986:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a6bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a6c3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.798992:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788638394.799008:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a6bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a6c3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.799014:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a6bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a6c3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.799028:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788638394.799031:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a68b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.799047:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6a00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:0.0:1788638394.799050:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a684 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a68b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638394.799163:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183589632:0@lo:103: 00000100:00100000:1.0:1788638394.799198:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638394.799248:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183589632 00000100:00100000:1.0:1788638394.799252:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183589632 00010000:00010000:1.0:1788638394.799272:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7380030c00/0xa0b1f1e3b4b2a6c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a6bc expref: 17 pid: 5835 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638394.799306:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788638394.799312:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:3294:x1875523183589632:12345-0@lo:103: 00010000:00010000:1.0:1788638394.799321:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638394.799326:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7380030c00/0xa0b1f1e3b4b2a6c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a6bc expref: 17 pid: 5835 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.799345:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7380030c00/0xa0b1f1e3b4b2a6c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a6bc expref: 17 pid: 5835 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.799362:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638394.799386:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:3294:x1875523183589632:12345-0@lo:103: Request processed in 75us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638394.799391:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788638394.799424:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183589632:0@lo:103: 00010000:00010000:1.0:1788638394.799457:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7380030c00/0xa0b1f1e3b4b2a6c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a6bc expref: 16 pid: 5835 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638394.799468:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875523183588992:0@lo:104: 00000100:00100000:1.0:1788638394.799475:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875523183589120:0@lo:104: 00000100:00100000:1.0:1788638394.799483:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875523183589248:0@lo:104: 00000100:00100000:1.0:1788638394.799490:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ed80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875523183589376:0@lo:104: 00000100:00100000:1.0:1788638394.799496:0:5837:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1875523183589504:0@lo:104: 00010000:00010000:1.0:1788638394.799513:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a6d8 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638394.799816:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788638394.799868:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a68b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638394.799875:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a684 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a68b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638394.799880:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788638394.799896:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a684 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a68b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.799901:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788638394.799936:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183589760:0@lo:103: 00000100:00100000:2.0:1788638394.799967:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788638394.799999:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a684 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a68b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.800005:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a684 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a68b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.800015:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788638394.800018:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a63e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a645 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.800024:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73829f0e00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:0.0:1788638394.800026:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a63e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a645 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.800041:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a63e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a645 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638394.800047:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a63e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a645 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638394.800062:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788638394.800075:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a63e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a645 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.800079:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788638394.800084:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a63e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a645 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.800090:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a63e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a645 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.800099:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638394.800102:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2a614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a61b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.800106:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031400 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:0.0:1788638394.800109:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2a614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a61b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.800123:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2a614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a61b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638394.800128:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2a614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a61b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638394.800138:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788638394.800150:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2a614 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a61b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.800155:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788638394.800162:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2a614 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a61b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.800168:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2a614 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a61b expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.800176:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638394.800177:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638394.800179:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638394.800417:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3292:1875523183589888:0@lo:103: 00000100:00100000:1.0:1788638394.800456:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183590016:0@lo:103: 00010000:00010000:0.0:1788638394.800833:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638394.800835:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638394.800837:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638394.800904:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a66f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.800912:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031200 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:1.0:1788638394.800915:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a668 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a66f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.800921:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a66f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638394.800928:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a66f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638394.800933:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788638394.800964:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a668 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a66f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.800970:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788638394.800985:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a668 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a66f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.800991:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a668 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a66f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.801005:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638394.801006:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638394.801008:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638394.801041:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183590144:0@lo:103: 00000100:00100000:0.0:1788638394.801413:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638394.801495:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638394.801527:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638394.801557:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183589760 00000100:00100000:1.0:1788638394.801563:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183589760 00010000:00010000:1.0:1788638394.801592:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2a68b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a684 expref: 16 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638394.801608:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183590016 00000100:00100000:1.0:1788638394.801610:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183590016 00010000:00010000:1.0:1788638394.801618:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a61b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a614 expref: 17 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638394.801626:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183589888 00000100:00100000:1.0:1788638394.801627:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183589888 00010000:00010000:1.0:1788638394.801635:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7381685a00/0xa0b1f1e3b4b2a645 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a63e expref: 18 pid: 5835 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638394.801643:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183590144 00000100:00100000:1.0:1788638394.801644:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183590144 00010000:00010000:1.0:1788638394.801652:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a66f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a668 expref: 19 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638394.801671:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788638394.801678:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3291:x1875523183589760:12345-0@lo:103: 00010000:00010000:1.0:1788638394.801687:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638394.801691:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2a68b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a684 expref: 19 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.801701:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2a68b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a684 expref: 19 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.801714:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2a68b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a684 expref: 19 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.801725:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638394.801753:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:3291:x1875523183589760:12345-0@lo:103: Request processed in 77us (1786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638394.801759:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788638394.801770:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788638394.801775:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:3293:x1875523183590016:12345-0@lo:103: 00010000:00010000:1.0:1788638394.801804:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638394.801808:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a61b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a614 expref: 17 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.801816:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a61b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a614 expref: 17 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.801824:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a61b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a614 expref: 17 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.801841:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638394.801866:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:3293:x1875523183590016:12345-0@lo:103: Request processed in 91us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638394.801871:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788638394.801883:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788638394.801888:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:3292:x1875523183589888:12345-0@lo:103: 00010000:00010000:1.0:1788638394.801895:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638394.801899:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7381685a00/0xa0b1f1e3b4b2a645 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a63e expref: 15 pid: 5835 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.801906:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7381685a00/0xa0b1f1e3b4b2a645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a63e expref: 15 pid: 5835 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.801915:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7381685a00/0xa0b1f1e3b4b2a645 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a63e expref: 15 pid: 5835 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.801924:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638394.801943:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:3292:x1875523183589888:12345-0@lo:103: Request processed in 56us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638394.801949:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788638394.801957:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788638394.801962:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:3294:x1875523183590144:12345-0@lo:103: 00010000:00010000:1.0:1788638394.801968:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638394.801971:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a66f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a668 expref: 13 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.801979:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a66f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a668 expref: 13 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.801992:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a66f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a668 expref: 13 pid: 5837 timeout: 307 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.802004:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a6d8 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.802011:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a6d8 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.802024:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a6d8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.802031:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a6d8 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.802037:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a6d8 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.802044:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a6d8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.802048:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7381685000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638394.802063:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a6d8 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.802070:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a6d8 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.802082:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a6d8 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.802102:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638394.802134:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:3294:x1875523183590144:12345-0@lo:103: Request processed in 172us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638394.802140:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788638394.802169:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3292:1875523183589888:0@lo:103: 00000100:00100000:1.0:1788638394.802190:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183590016:0@lo:103: 00000100:00100000:1.0:1788638394.802203:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183590144:0@lo:103: 00010000:00010000:1.0:1788638394.802218:0:5837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a6d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.802225:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a6d8 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.802232:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a6d8 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788638394.802243:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788638394.807874:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183589760:0@lo:103: 00000100:00100000:1.0:1788638394.916433:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:7632:x1875523183588864:12345-0@lo:253: Request processed in 171539us (173969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638394.916450:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788638394.920185:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183588864:0@lo:253: 10000000:01000000:2.0:1788638394.920209:0:7632:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788638394.920212:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788638394.920214:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788638394.920215:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788638394.920217:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1788638394.920218:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788638394.920219:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788638394.920221:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788638394.920222:0:7632:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788638394.920224:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788638394.920225:0:7632:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788638394.920256:0:7632:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c73b4c0d800 from lustre-OST0001 10000000:01000000:2.0:1788638394.920284:0:7632:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788638394.920287:0:7632:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788638394.920427:0:7632:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c738375b380 local copy 10000000:01000000:2.0:1788638394.920432:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788638394.920476:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7600/0xa0b1f1e3b4b2a6df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638394.920490:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7600/0xa0b1f1e3b4b2a6df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638394.920500:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7600/0xa0b1f1e3b4b2a6df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638394.920518:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183590272:0@lo:101: 00000100:00100000:2.0:1788638394.920598:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638394.920644:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387cf10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638394.920811:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183590272 00000100:00100000:0.0:1788638394.920818:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183590272 00000100:00100000:0.0:1788638394.920865:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788638394.920875:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+11:7632:x1875523183590272:12345-0@lo:101: 00010000:00010000:0.0:1788638394.920891:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638394.920905:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7380031400/0xa0b1f1e3b4b2a6e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a6df expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.920927:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7380031400/0xa0b1f1e3b4b2a6e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a6df expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.920938:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7380031400/0xa0b1f1e3b4b2a6e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a6df expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.920962:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031400, rc 0) 00000100:00100000:0.0:1788638394.921010:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:7632:x1875523183590272:12345-0@lo:101: Request processed in 137us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638394.921016:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788638394.923213:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183590272:0@lo:101: 00010000:00010000:3.0:1788638394.923251:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7600/0xa0b1f1e3b4b2a6df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa0b1f1e3b4b2a6e6 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638394.923275:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7600/0xa0b1f1e3b4b2a6df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa0b1f1e3b4b2a6e6 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638394.923567:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183590400:0@lo:501: 00000100:00100000:3.0:1788638394.924103:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638394.924202:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32480 going to sleep for 11 seconds 00000100:00100000:1.0:1788638394.924500:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183590400 00000100:00100000:1.0:1788638394.924507:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183590400 00000100:00100000:1.0:1788638394.924568:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788638394.924587:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:7632:x1875523183590400:12345-0@lo:501: 00000100:00100000:1.0:1788638394.924911:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:7632:x1875523183590400:12345-0@lo:501: Request processed in 326us (832us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788638394.924929:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788638394.925214:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183590400:0@lo:501: 10000000:01000000:3.0:1788638394.925237:0:7632:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788638394.925270:0:7632:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788638394.925277:0:7632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7600/0xa0b1f1e3b4b2a6df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa0b1f1e3b4b2a6e6 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638394.925287:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7600/0xa0b1f1e3b4b2a6df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa0b1f1e3b4b2a6e6 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638394.925374:0:7632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7600/0xa0b1f1e3b4b2a6df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa0b1f1e3b4b2a6e6 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638394.925400:0:7632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788638394.925428:0:7632:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c73b4c0d800 10000000:01000000:3.0:1788638394.925433:0:7632:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788638394.925439:0:7632:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788638394.925442:0:7632:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788638394.925447:0:7632:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788638394.925450:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788638394.925474:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73829f1000/0xa0b1f1e3b4b2a6ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638394.925482:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73829f1000/0xa0b1f1e3b4b2a6ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638394.925492:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73829f1000/0xa0b1f1e3b4b2a6ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638394.925508:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183590528:0@lo:101: 00000100:00100000:3.0:1788638394.926748:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638394.926807:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788638394.926927:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183590528 00000100:00100000:0.0:1788638394.926935:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183590528 00000100:00100000:0.0:1788638394.926985:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788638394.926994:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:7632:x1875523183590528:12345-0@lo:101: 00010000:00010000:0.0:1788638394.927011:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638394.927027:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7380030400/0xa0b1f1e3b4b2a6f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a6ed expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.927063:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7380030400/0xa0b1f1e3b4b2a6f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a6ed expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.927077:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7380030400/0xa0b1f1e3b4b2a6f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a6ed expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.927085:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030400, rc 0) 00000100:00100000:0.0:1788638394.927139:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:7632:x1875523183590528:12345-0@lo:101: Request processed in 146us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638394.927145:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788638394.927661:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183590528:0@lo:101: 00010000:00010000:3.0:1788638394.927678:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73829f1000/0xa0b1f1e3b4b2a6ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a6f4 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638394.927689:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73829f1000/0xa0b1f1e3b4b2a6ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a6f4 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638394.927859:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183590656:0@lo:501: 00000100:00100000:3.0:1788638394.927895:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638394.927930:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788638394.927947:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183590656 00000100:00100000:3.0:1788638394.927951:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183590656 00000100:00100000:3.0:1788638394.927977:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788638394.927987:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:7632:x1875523183590656:12345-0@lo:501: 00000100:00100000:3.0:1788638394.928236:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:7632:x1875523183590656:12345-0@lo:501: Request processed in 251us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638394.928242:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788638394.928271:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183590656:0@lo:501: 00010000:00010000:1.0:1788638394.928796:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638394.928805:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7600/0xa0b1f1e3b4b2a6df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa0b1f1e3b4b2a6e6 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.928813:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7600 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:1.0:1788638394.928818:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7600/0xa0b1f1e3b4b2a6df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa0b1f1e3b4b2a6e6 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.928827:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7600/0xa0b1f1e3b4b2a6df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa0b1f1e3b4b2a6e6 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638394.928835:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7600/0xa0b1f1e3b4b2a6df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa0b1f1e3b4b2a6e6 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638394.928841:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788638394.928864:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7600/0xa0b1f1e3b4b2a6df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa0b1f1e3b4b2a6e6 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.928870:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788638394.928896:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7600/0xa0b1f1e3b4b2a6df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa0b1f1e3b4b2a6e6 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.928903:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7600/0xa0b1f1e3b4b2a6df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa0b1f1e3b4b2a6e6 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.928915:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638394.928917:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638394.928918:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638394.928926:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788638394.928947:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3292:1875523183590784:0@lo:103: 00000100:00100000:1.0:1788638394.928980:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638394.929012:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183590784 00000100:00100000:1.0:1788638394.929017:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183590784 00000100:00100000:1.0:1788638394.929053:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788638394.929061:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:3292:x1875523183590784:12345-0@lo:103: 00010000:00010000:1.0:1788638394.929071:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638394.929084:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7380031400/0xa0b1f1e3b4b2a6e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a6df expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.929094:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638394.929126:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:3292:x1875523183590784:12345-0@lo:103: Request processed in 64us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638394.929133:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788638394.929163:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3292:1875523183590784:0@lo:103: 00000100:00100000:3.0:1788638394.930679:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183590912:0@lo:503: 00000100:00100000:3.0:1788638394.930757:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638394.930812:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788638394.930841:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183590912 00000100:00100000:3.0:1788638394.930847:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183590912 00000100:00100000:3.0:1788638394.930886:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788638394.930894:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:7632:x1875523183590912:12345-0@lo:503: 00000100:00100000:3.0:1788638394.931103:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:7632:x1875523183590912:12345-0@lo:503: Request processed in 209us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638394.931110:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788638394.931278:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183590912:0@lo:503: 00000040:00080000:2.0:1788638394.931634:0:7632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788638394.931716:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183591040:0@lo:502: 00000100:00100000:2.0:1788638394.931767:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638394.931823:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387cf1780 going to sleep for 11 seconds 00000100:00100000:1.0:1788638394.932051:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183591040 00000100:00100000:1.0:1788638394.932056:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183591040 00000100:00100000:1.0:1788638394.932087:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788638394.932095:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:7632:x1875523183591040:12345-0@lo:502: 00000100:00100000:1.0:1788638394.932429:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:7632:x1875523183591040:12345-0@lo:502: Request processed in 334us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638394.932437:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788638394.932510:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183591040:0@lo:502: 00000040:00080000:1.0:1788638394.932920:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788638394.932970:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788638394.933006:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788638394.933055:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788638394.933111:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788638394.933146:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788638394.933176:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183591168:0@lo:502: 00000100:00100000:1.0:1788638394.933225:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638394.933249:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7386665180 going to sleep for 11 seconds 00000100:00100000:1.0:1788638394.933274:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183591168 00000100:00100000:1.0:1788638394.933278:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183591168 00000100:00100000:1.0:1788638394.933303:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788638394.933310:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:7632:x1875523183591168:12345-0@lo:502: 00000100:00100000:1.0:1788638394.933535:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:7632:x1875523183591168:12345-0@lo:502: Request processed in 223us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638394.933541:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788638394.933625:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183591168:0@lo:502: 00000040:00080000:1.0:1788638394.933770:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788638394.933819:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788638394.934124:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788638394.934132:0:7641:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788638394.934138:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638394.934140:0:7641:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788638394.934145:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788638394.934160:0:7641:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c73880ab380) 00000020:00000080:1.0:1788638394.934181:0:7641:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788638394.934187:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788638394.934243:0:7641:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c73b4c0d800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788638394.934251:0:7641:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788638394.934258:0:7641:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa0b1f1e3b4b2a702 00010000:00010000:1.0:1788638394.942280:0:7641:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788638394.943448:0:7641:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788638394.947280:0:7641:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788638394.947634:0:7641:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788638394.965243:0:7641:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788638394.968236:0:7641:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788638394.970459:0:7641:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788638394.970473:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788638394.970479:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638394.970480:0:7641:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788638394.970484:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788638394.970488:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638394.970489:0:7641:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788638394.970492:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788638394.970493:0:7641:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788638394.970560:0:7641:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788638394.970571:0:7641:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638394.970573:0:7641:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788638394.970576:0:7641:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788638394.971023:0:7632:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1788638394.971058:0:7632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788638394.971077:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73829f1000/0xa0b1f1e3b4b2a6ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a6f4 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638394.971089:0:7632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73829f1000/0xa0b1f1e3b4b2a6ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a6f4 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638394.971097:0:7632:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c73b4c0d800 from 1 10000000:01000000:2.0:1788638394.971100:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788638394.971137:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a709 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638394.971146:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a709 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638394.971157:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a709 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638394.971177:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183591296:0@lo:101: 00000100:00100000:2.0:1788638394.971243:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638394.971295:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387cf1780 going to sleep for 11 seconds 00000100:00100000:1.0:1788638394.971434:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183591296 00000100:00100000:1.0:1788638394.971442:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183591296 00000100:00100000:1.0:1788638394.971492:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788638394.971501:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:7632:x1875523183591296:12345-0@lo:101: 00010000:00010000:1.0:1788638394.971517:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638394.971690:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a710 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a709 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.971717:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a710 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a709 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.971729:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a710 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a709 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.971738:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7381685000, rc 0) 00000100:00100000:1.0:1788638394.971806:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:7632:x1875523183591296:12345-0@lo:101: Request processed in 283us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638394.971813:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788638394.972003:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183591296:0@lo:101: 00010000:00010000:1.0:1788638394.972019:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a709 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a710 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638394.972029:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a709 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a710 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638394.972138:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183591424:0@lo:501: 00000100:00100000:1.0:1788638394.972167:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638394.972181:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7386665900 going to sleep for 11 seconds 00000100:00100000:2.0:1788638394.973874:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183591424 00000100:00100000:2.0:1788638394.973886:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183591424 00000100:00100000:2.0:1788638394.973944:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788638394.973955:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:7632:x1875523183591424:12345-0@lo:501: 00000100:00100000:2.0:1788638394.974310:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:7632:x1875523183591424:12345-0@lo:501: Request processed in 357us (2141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638394.974319:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788638394.975171:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183591424:0@lo:501: 00000100:00100000:1.0:1788638394.975224:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183591552:0@lo:503: 00000100:00100000:1.0:1788638394.976036:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638394.976078:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7386665900 going to sleep for 11 seconds 00000100:00100000:2.0:1788638394.976393:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183591552 00000100:00100000:2.0:1788638394.976402:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183591552 00000100:00100000:2.0:1788638394.976458:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788638394.976467:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:7632:x1875523183591552:12345-0@lo:503: 00000100:00100000:2.0:1788638394.977658:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:7632:x1875523183591552:12345-0@lo:503: Request processed in 1187us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638394.977670:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788638394.978399:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183591552:0@lo:503: 00000040:00080000:1.0:1788638394.979309:0:7632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788638394.979406:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183591680:0@lo:502: 00000100:00100000:1.0:1788638394.979479:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638394.979541:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7386665900 going to sleep for 11 seconds 00000100:00100000:3.0:1788638394.979597:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183591680 00000100:00100000:3.0:1788638394.979604:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183591680 00000100:00100000:3.0:1788638394.979651:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788638394.979660:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:7632:x1875523183591680:12345-0@lo:502: 00000100:00100000:3.0:1788638394.979919:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:7632:x1875523183591680:12345-0@lo:502: Request processed in 259us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638394.979928:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788638394.979978:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183591680:0@lo:502: 00000040:00080000:3.0:1788638394.980267:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788638394.980315:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788638394.980348:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183591808:0@lo:502: 00000100:00100000:3.0:1788638394.980384:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638394.980405:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32000 going to sleep for 11 seconds 00000100:00100000:2.0:1788638394.981119:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183591808 00000100:00100000:2.0:1788638394.981127:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183591808 00000100:00100000:2.0:1788638394.981167:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788638394.981175:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:7632:x1875523183591808:12345-0@lo:502: 00000100:00100000:2.0:1788638394.981370:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:7632:x1875523183591808:12345-0@lo:502: Request processed in 195us (984us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638394.981377:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788638394.985145:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183591808:0@lo:502: 00000040:00080000:3.0:1788638394.985391:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788638394.985409:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788638394.987140:0:7645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788638394.987152:0:7645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638394.987154:0:7645:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788638394.987161:0:7645:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c73b4c0d800 00000020:00000080:3.0:1788638394.987163:0:7645:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788638394.987178:0:7645:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638394.987181:0:7645:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638394.987182:0:7645:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788638394.987185:0:7645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788638394.990352:0:7632:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788638394.990403:0:7632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788638394.990422:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a709 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a710 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.990437:0:7632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a709 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a710 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638394.990510:0:7632:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788638394.990513:0:7632:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c73b4c0d800 10000000:01000000:0.0:1788638394.990517:0:7632:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c73b4c0d800 10000000:01000000:0.0:1788638394.990522:0:7632:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788638394.990528:0:7632:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c73b4c0d800 from 1 10000000:01000000:0.0:1788638394.990530:0:7632:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788638394.991047:0:7632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2a717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.991059:0:7632:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2a717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.991072:0:7632:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2a717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638394.991098:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183591936:0@lo:101: 00000100:00100000:0.0:1788638394.991165:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638394.991199:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387969b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788638394.992281:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183591936 00000100:00100000:2.0:1788638394.992302:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183591936 00000100:00100000:2.0:1788638394.992366:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788638394.992376:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:7632:x1875523183591936:12345-0@lo:101: 00010000:00010000:2.0:1788638394.992390:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638394.992405:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7399aa7800/0xa0b1f1e3b4b2a71e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a717 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638394.992429:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7399aa7800/0xa0b1f1e3b4b2a71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a717 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638394.992457:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7399aa7800/0xa0b1f1e3b4b2a71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a717 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638394.992466:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7800, rc 0) 00000100:00100000:2.0:1788638394.992520:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:7632:x1875523183591936:12345-0@lo:101: Request processed in 145us (1355us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638394.992527:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788638394.993199:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183591936:0@lo:101: 00010000:00010000:0.0:1788638394.993219:0:7632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2a717 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a71e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638394.993230:0:7632:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2a717 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a71e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638394.993375:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183592064:0@lo:501: 00000100:00100000:0.0:1788638394.993419:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638394.993468:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387969b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788638394.993669:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183592064 00000100:00100000:3.0:1788638394.993675:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183592064 00000100:00100000:3.0:1788638394.993704:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788638394.993712:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:7632:x1875523183592064:12345-0@lo:501: 00000100:00100000:3.0:1788638394.994032:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:7632:x1875523183592064:12345-0@lo:501: Request processed in 319us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638394.994039:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788638394.994085:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183592064:0@lo:501: 00000100:00100000:3.0:1788638394.994114:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183592192:0@lo:503: 00000100:00100000:3.0:1788638394.994149:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638394.994166:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32540 going to sleep for 11 seconds 00000100:00100000:2.0:1788638394.994777:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183592192 00000100:00100000:2.0:1788638394.994800:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183592192 00000100:00100000:2.0:1788638394.994847:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788638394.994856:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:7632:x1875523183592192:12345-0@lo:503: 00000100:00100000:2.0:1788638394.995030:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:7632:x1875523183592192:12345-0@lo:503: Request processed in 176us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638394.995037:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788638394.997199:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183592192:0@lo:503: 00000040:00080000:3.0:1788638394.997774:0:7632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788638394.997870:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183592320:0@lo:502: 00000100:00100000:3.0:1788638394.997941:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638394.997978:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7383730c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788638394.999900:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183592320 00000100:00100000:2.0:1788638394.999913:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183592320 00000100:00100000:2.0:1788638394.999983:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788638395.000017:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:7632:x1875523183592320:12345-0@lo:502: 00000100:00100000:2.0:1788638395.000409:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:7632:x1875523183592320:12345-0@lo:502: Request processed in 394us (2467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638395.000423:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788638395.003650:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183592320:0@lo:502: 00000040:00080000:3.0:1788638395.004050:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788638395.004119:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788638395.004153:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788638395.004209:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788638395.004248:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788638395.004293:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788638395.004343:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788638395.004376:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788638395.004428:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788638395.004478:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788638395.004514:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788638395.004562:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788638395.004598:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788638395.004630:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788638395.004675:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788638395.004712:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788638395.004745:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788638395.004815:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788638395.004864:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788638395.004905:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788638395.004957:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788638395.004988:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788638395.005018:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788638395.005063:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788638395.005095:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788638395.005126:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788638395.005170:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788638395.005204:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788638395.005237:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788638395.005282:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788638395.005316:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788638395.005362:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788638395.005396:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788638395.005442:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788638395.005490:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788638395.005538:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788638395.005574:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788638395.005619:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183592448:0@lo:502: 00000100:00100000:3.0:1788638395.005695:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638395.005746:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7383730c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788638395.005902:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183592448 00000100:00100000:2.0:1788638395.005910:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183592448 00000100:00100000:2.0:1788638395.005964:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788638395.005974:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:7632:x1875523183592448:12345-0@lo:502: 00000100:00100000:2.0:1788638395.006245:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:7632:x1875523183592448:12345-0@lo:502: Request processed in 272us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638395.006262:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788638395.017982:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183592448:0@lo:502: 00000040:00080000:0.0:1788638395.018201:0:7632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1788638395.018217:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788638395.019375:0:7646:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788638395.019396:0:7646:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c7385323380) 00000020:00000080:2.0:1788638395.019422:0:7646:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788638395.019922:0:7646:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c73b4c0d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788638395.019929:0:7646:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c73b4c0d800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788638395.019932:0:7646:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c73b4c0d800 3 00010000:00080000:2.0:1788638395.019977:0:7646:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c73ad654000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.134@tcp at head 00010000:00010000:2.0:1788638395.028272:0:7646:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788638395.028491:0:7646:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788638395.028531:0:7646:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788638395.028544:0:7646:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa0b1f1e3b4b2a72c 00000100:00080000:2.0:1788638395.028553:0:7646:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788638395.028559:0:7646:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c73ad654000 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:2.0:1788638395.028592:0:7646:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73837d7480 x1875523183592576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788638395.028611:0:7646:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788638395.028770:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788638395.028798:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183592704:0@lo:400: 00000100:00100000:3.0:1788638395.028861:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638395.028901:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183592832:0@lo:400: 00000100:00100000:3.0:1788638395.028923:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638395.028940:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788638395.028946:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183592960:0@lo:400: 00000100:00100000:3.0:1788638395.028973:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638395.029001:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183592704 00000100:00100000:3.0:1788638395.029014:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183592704 00000100:00100000:3.0:1788638395.029051:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183592832 00000100:00100000:3.0:1788638395.029054:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183592832 00000100:00100000:3.0:1788638395.029075:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788638395.029084:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183592704:12345-0@lo:400: 00000100:00100000:3.0:1788638395.029137:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdcaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183592704:12345-0@lo:400: Request processed in 53us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638395.029144:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788638395.029158:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788638395.029163:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183592832:12345-0@lo:400: 00000100:00100000:3.0:1788638395.029193:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183592832:12345-0@lo:400: Request processed in 29us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638395.029199:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788638395.029227:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183592960 00000100:00100000:3.0:1788638395.029231:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183592960 00000100:00100000:3.0:1788638395.029254:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638395.029260:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183592960:12345-0@lo:400: 00000100:00100000:3.0:1788638395.029289:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183592960:12345-0@lo:400: Request processed in 29us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638395.029295:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788638395.029347:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73acdcb480 x1875523183592960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638395.029361:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183592960:0@lo:400: 00010000:00080000:3.0:1788638395.029374:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73acdc9c00 x1875523183592832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638395.029383:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183592832:0@lo:400: 00010000:00080000:3.0:1788638395.029425:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73acdca300 x1875523183592704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638395.029434:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183592704:0@lo:400: 00000100:00100000:0.0:1788638395.029614:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1875523183592576:0@lo:38: 00000100:00100000:0.0:1788638395.029651:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638395.032276:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183592576 00000100:00100000:3.0:1788638395.032291:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183592576 00000100:00100000:3.0:1788638395.032350:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788638395.032359:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1875523183592576:12345-0@lo:38: 00010000:00080000:3.0:1788638395.032388:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 158 last 0 00000020:00000080:3.0:1788638395.032422:0:5842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa0b1f1e3b4b2a733 00000004:00100000:3.0:1788638395.032439:0:5842:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788638395.032473:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9c73ad472800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788638395.032554:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875523183592576:12345-0@lo:38: Request processed in 195us (2903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638395.032577:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788638395.032627:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73837d7480 x1875523183592576/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788638405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638395.032639:0:3290:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788638395.032648:0:3290:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1788638395.032655:0:3290:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788638395.032660:0:3290:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788638395.032663:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73ad654000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788638395.032669:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1875523183592576:0@lo:38: 00000040:00080000:3.0:1788638395.032871:0:7646:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1788638395.033003:0:7632:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 00000100:00100000:3.0:1788638395.033018:0:7648:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdca300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7648:1875523183593088:0@lo:901: 10000000:01000000:1.0:1788638395.033029:0:7632:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788638395.033046:0:7632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2a717 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a71e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638395.033055:0:7648:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788638395.033056:0:7632:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2a717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a71e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638395.033089:0:7648:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7383730d80 going to sleep for 11 seconds 00000020:01000004:1.0:1788638395.033111:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788638395.033113:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788638395.033114:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638395.033116:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638395.033117:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638395.033119:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638395.033120:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788638395.033122:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788638395.033123:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788638395.033125:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638395.033126:0:7632:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788638395.033130:0:7632:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1788638395.033132:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788638395.033134:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788638395.033135:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638395.033136:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638395.033137:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638395.033138:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638395.033139:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788638395.033140:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788638395.033142:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788638395.033143:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638395.033144:0:7632:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788638395.033158:0:7632:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788638395.033165:0:7632:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183593216:0@lo:253: 00000100:00100000:1.0:1788638395.033214:0:7632:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638395.033247:0:7632:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7386665180 going to sleep for 11 seconds 00000100:00100000:1.0:1788638395.033280:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183593088 00000100:00100000:1.0:1788638395.033284:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183593088 00000100:00100000:1.0:1788638395.033336:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788638395.033345:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7648:x1875523183593088:12345-0@lo:901: 00000100:00100000:1.0:1788638395.033721:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7648:x1875523183593088:12345-0@lo:901: Request processed in 378us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638395.033729:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788638395.033754:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638395.034799:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183593216 00000100:00100000:3.0:1788638395.034808:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183593216 00000100:00100000:3.0:1788638395.034855:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788638395.034864:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:7632:x1875523183593216:12345-0@lo:253: 20000000:01000000:3.0:1788638395.034889:0:5834:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788638395.034902:0:5834:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1788638395.039467:0:7648:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73acdca300 x1875523183593088/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788638411 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638395.039486:0:7648:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdca300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7648:1875523183593088:0@lo:901: 20000000:01000000:3.0:1788638395.128334:0:5834:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788638395.128352:0:5834:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1788638395.128722:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788638395.128728:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788638395.128749:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a73a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638395.128768:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c73829f0600/0xa0b1f1e3b4b2a67d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a676 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638395.128776:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a73a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638395.128842:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c73829f0600/0xa0b1f1e3b4b2a67d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a676 expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638395.128857:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c73829f0600/0xa0b1f1e3b4b2a67d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a676 expref: 14 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638395.128871:0:5858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875523183593344:0@lo:104: 00000100:00100000:1.0:1788638395.128931:0:5858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638395.128984:0:5858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7386665c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788638395.129040:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183593344 00000100:00100000:0.0:1788638395.129047:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183593344 00000100:00100000:0.0:1788638395.129095:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788638395.129104:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:5858:x1875523183593344:12345-0@lo:104: 00010000:00010000:0.0:1788638395.129124:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a67d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638395.129172:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788638395.129178:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:5858:x1875523183593344:12345-0@lo:104: Request processed in 76us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638395.129185:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788638395.129204:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638395.129210:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a67d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638395.129218:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030e00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:0.0:1788638395.129222:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a676 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a67d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638395.129229:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a67d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638395.129237:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a676 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a67d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638395.129255:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788638395.129283:0:7639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a676 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a67d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638395.129290:0:7639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788638395.129306:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a676 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a67d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638395.129313:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a676 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a67d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638395.129339:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638395.129341:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638395.129342:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638395.129361:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183593472:0@lo:103: 00000100:00100000:0.0:1788638395.129391:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638395.129421:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183593472 00000100:00100000:0.0:1788638395.129425:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183593472 00010000:00010000:0.0:1788638395.129441:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c73829f0600/0xa0b1f1e3b4b2a67d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a676 expref: 15 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638395.129474:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788638395.129481:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:3291:x1875523183593472:12345-0@lo:103: 00010000:00010000:0.0:1788638395.129491:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638395.129496:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c73829f0600/0xa0b1f1e3b4b2a67d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a676 expref: 15 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638395.129505:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c73829f0600/0xa0b1f1e3b4b2a67d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a676 expref: 15 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638395.129526:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a73a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638395.129534:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a73a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788638395.129546:0:5827:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003600654s 00010000:00010000:0.0:1788638395.129550:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a73a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638395.129557:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a73a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638395.129564:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a73a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638395.129571:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a73a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638395.129750:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7381684a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638395.129755:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a73a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638395.129762:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a73a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638395.129772:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a73a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638395.129816:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638395.129845:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dffc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:3291:x1875523183593472:12345-0@lo:103: Request processed in 365us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638395.129856:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788638395.129918:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183593472:0@lo:103: 00010000:00010000:0.0:1788638395.129943:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73829f0600/0xa0b1f1e3b4b2a67d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a676 expref: 14 pid: 5835 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638395.129954:0:5858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1875523183593344:0@lo:104: 00010000:00010000:0.0:1788638395.129965:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a73a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638395.129973:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a73a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638395.129979:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a73a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638395.129985:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a73a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638395.153996:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:7632:x1875523183593216:12345-0@lo:253: Request processed in 119124us (120772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638395.154013:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788638395.154144:0:7632:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7632:1875523183593216:0@lo:253: 10000000:01000000:1.0:1788638395.154160:0:7632:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788638395.154163:0:7632:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788638395.154165:0:7632:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788638395.154167:0:7632:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638395.154168:0:7632:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638395.154170:0:7632:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638395.154171:0:7632:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638395.154173:0:7632:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788638395.154174:0:7632:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788638395.154176:0:7632:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788638395.154178:0:7632:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638395.154190:0:7632:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788638395.154205:0:7632:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788638395.168558:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788638395.169846:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788638395.170134:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788638395.170889:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788638395.171114:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788638395.171902:0:7632:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788638395.173256:0:7632:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1788638395.257846:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788638395.565251:0:7632:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788638395.565259:0:7632:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788638395.565315:0:7632:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788638395.565389:0:7632:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.134@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788638395.565408:0:7632:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788638395.565437:0:7632:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1788638396.324229:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638397.344428:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638398.385150:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638399.392008:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638399.717259:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183593600:0@lo:13: 00000100:00100000:3.0:1788638399.717342:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638399.720826:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183593600 00000100:00100000:3.0:1788638399.720840:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183593600 00000100:00100000:3.0:1788638399.720917:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788638399.720928:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183593600:12345-0@lo:13: 00002000:00000024:3.0:1788638399.720970:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788638399.721018:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788638399.721043:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183593600:12345-0@lo:13: Request processed in 118us (3701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638399.721050:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788638399.721057:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73ad30f100 x1875523183593600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638399.721093:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183593600:0@lo:13: 00000100:00100000:0.0:1788638400.226948:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183593728:0@lo:400: 00000100:00100000:1.0:1788638400.226996:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183593984:0@lo:400: 00000100:00100000:0.0:1788638400.227028:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638400.228499:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183594112:0@lo:400: 00000100:00100000:0.0:1788638400.240171:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183594240:0@lo:400: 00000100:00100000:0.0:1788638400.240263:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638400.240486:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788638400.240494:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183593856:0@lo:400: 00000100:00100000:0.0:1788638400.241228:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638400.241302:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183593728 00000100:00100000:0.0:1788638400.241311:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183593728 00000100:00100000:0.0:1788638400.241370:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788638400.241380:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:3293:x1875523183593728:12345-0@lo:400: 00000100:00100000:0.0:1788638400.241437:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:3293:x1875523183593728:12345-0@lo:400: Request processed in 59us (14411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638400.241444:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788638400.241496:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183594240 00000100:00100000:0.0:1788638400.241500:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183594240 00000100:00100000:0.0:1788638400.241700:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183593856 00000100:00100000:0.0:1788638400.241704:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183593856 00000100:00100000:0.0:1788638400.241724:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788638400.241730:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183594240:12345-0@lo:400: 00000100:00100000:0.0:1788638400.241766:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4659880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183594240:12345-0@lo:400: Request processed in 36us (1505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638400.241773:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788638400.241802:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788638400.241809:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b465ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183593856:12345-0@lo:400: 00000100:00100000:0.0:1788638400.241837:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b465ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183593856:12345-0@lo:400: Request processed in 29us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638400.241843:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788638400.241885:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73837a6d80 x1875523183593856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638400.241916:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183593856:0@lo:400: 00000100:00100000:0.0:1788638400.241930:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183593728:0@lo:400: 00010000:00080000:0.0:1788638400.241941:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73837a7b80 x1875523183594240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638400.241949:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183594240:0@lo:400: 00000100:00080000:3.0:1788638400.243419:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638400.258903:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638400.259247:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183594112 00000100:00100000:3.0:1788638400.259257:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183594112 00000100:00100000:3.0:1788638400.259338:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788638400.259349:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183594112:12345-0@lo:400: 00000100:00100000:2.0:1788638400.259464:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183594112:12345-0@lo:400: Request processed in 116us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638400.259471:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788638400.259527:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73837a5180 x1875523183594112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638400.259543:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183594112:0@lo:400: 00000100:00100000:1.0:1788638400.264146:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638400.265374:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183593984 00000100:00100000:3.0:1788638400.265386:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183593984 00000100:00080000:1.0:1788638400.265436:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638400.265456:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788638400.265465:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183593984:12345-0@lo:400: 00000100:00100000:3.0:1788638400.265558:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183593984:12345-0@lo:400: Request processed in 94us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638400.265567:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788638400.265599:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73837a4e00 x1875523183593984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638400.265614:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183593984:0@lo:400: 00010000:00010000:2.0:1788638400.419950:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638401.444352:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788638401.762616:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788638401.762624:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c73bce5d800 from 30 10000000:01000000:1.0:1788638401.762630:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788638401.762679:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7381684200/0xa0b1f1e3b4b2a741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638401.762691:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7381684200/0xa0b1f1e3b4b2a741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638401.762704:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7381684200/0xa0b1f1e3b4b2a741 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638401.762729:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183594368:0@lo:101: 00000100:00100000:1.0:1788638401.765261:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638401.765368:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32300 going to sleep for 11 seconds 00000100:00100000:2.0:1788638401.783620:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183594368 00000100:00100000:2.0:1788638401.783633:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183594368 00000100:00100000:2.0:1788638401.783694:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788638401.783704:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:5840:x1875523183594368:12345-0@lo:101: 00010000:00010000:2.0:1788638401.783720:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638401.783740:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a748 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a741 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638401.783765:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a741 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638401.783776:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a741 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638401.783803:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6800, rc 0) 00000100:00100000:2.0:1788638401.783878:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:5840:x1875523183594368:12345-0@lo:101: Request processed in 174us (19377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638401.783884:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788638401.783942:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183594368:0@lo:101: 00010000:00010000:2.0:1788638401.783959:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7381684200/0xa0b1f1e3b4b2a741 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a748 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638401.783980:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7381684200/0xa0b1f1e3b4b2a741 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a748 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638401.784055:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183594496:0@lo:501: 00000100:00100000:2.0:1788638401.784088:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638401.784118:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304a3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638401.784134:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183594496 00000100:00100000:2.0:1788638401.784137:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183594496 00000100:00100000:2.0:1788638401.784157:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788638401.784162:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:5840:x1875523183594496:12345-0@lo:501: 00000100:00100000:1.0:1788638401.784837:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183594496:0@lo:501: 00000100:00100000:1.0:1788638401.784874:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183594624:0@lo:503: 00000100:00100000:2.0:1788638401.784939:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:5840:x1875523183594496:12345-0@lo:501: Request processed in 775us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638401.784947:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788638401.790406:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638401.790469:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c329c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638401.790595:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183594624 00000100:00100000:0.0:1788638401.790605:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183594624 00000100:00100000:0.0:1788638401.790660:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788638401.790670:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:5840:x1875523183594624:12345-0@lo:503: 00000100:00100000:0.0:1788638401.791181:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:5840:x1875523183594624:12345-0@lo:503: Request processed in 512us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638401.791189:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788638401.791317:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183594624:0@lo:503: 00000100:00100000:1.0:1788638401.797810:0:7949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7949:1875523183594752:0@lo:502: 00000100:00100000:1.0:1788638401.797904:0:7949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638401.797947:0:7949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788638401.798092:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183594752 00000100:00100000:0.0:1788638401.798100:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183594752 00000100:00100000:0.0:1788638401.798143:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788638401.798153:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:7949:x1875523183594752:12345-0@lo:502: 00000100:00100000:0.0:1788638401.798503:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:7949:x1875523183594752:12345-0@lo:502: Request processed in 350us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638401.798576:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788638401.798681:0:7949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7949:1875523183594752:0@lo:502: 00000100:00100000:1.0:1788638401.799500:0:7949:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7949:1875523183594880:0@lo:502: 00000100:00100000:1.0:1788638401.801909:0:7949:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638401.801952:0:7949:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788638401.805579:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183594880 00000100:00100000:2.0:1788638401.805594:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183594880 00000100:00100000:2.0:1788638401.805651:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788638401.805661:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:7949:x1875523183594880:12345-0@lo:502: 00000100:00100000:2.0:1788638401.806025:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:7949:x1875523183594880:12345-0@lo:502: Request processed in 364us (4121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638401.806032:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788638401.806042:0:7949:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7949:1875523183594880:0@lo:502: 00000040:00080000:1.0:1788638401.806082:0:7949:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788638401.810060:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788638401.810099:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788638401.810110:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7381684200/0xa0b1f1e3b4b2a741 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a748 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638401.810123:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7381684200/0xa0b1f1e3b4b2a741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a748 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638401.810141:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788638401.810143:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788638401.810146:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788638401.810187:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a74f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638401.810201:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a74f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638401.810212:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a74f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638401.810235:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4659500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183595008:0@lo:101: 00000100:00100000:0.0:1788638401.810311:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638401.810356:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d906c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638401.810382:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183595008 00000100:00100000:0.0:1788638401.810389:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183595008 00000100:00100000:0.0:1788638401.810452:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788638401.810463:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:5840:x1875523183595008:12345-0@lo:101: 00010000:00010000:0.0:1788638401.810483:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638401.810500:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2a756 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a74f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638401.810529:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2a756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a74f expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638401.810542:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2a756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a74f expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638401.810562:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031e00, rc 0) 00000100:00100000:0.0:1788638401.810608:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:5840:x1875523183595008:12345-0@lo:101: Request processed in 146us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638401.810616:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788638401.810677:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4659500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183595008:0@lo:101: 00010000:00010000:0.0:1788638401.810694:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a74f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a756 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638401.810705:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a74f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a756 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638401.810757:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4659500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183595136:0@lo:501: 00000100:00100000:0.0:1788638401.810797:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638401.810815:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d906c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638401.810828:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183595136 00000100:00100000:2.0:1788638401.810832:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183595136 00000100:00100000:2.0:1788638401.810865:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788638401.810871:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:5840:x1875523183595136:12345-0@lo:501: 00000100:00100000:2.0:1788638401.811172:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:5840:x1875523183595136:12345-0@lo:501: Request processed in 300us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638401.811187:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788638401.811217:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4659500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183595136:0@lo:501: 00000100:00100000:2.0:1788638401.811244:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183595264:0@lo:503: 00000100:00100000:2.0:1788638401.816803:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638401.816894:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788638401.816942:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183595264 00000100:00100000:2.0:1788638401.816952:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183595264 00000100:00100000:2.0:1788638401.817020:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788638401.817030:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:5840:x1875523183595264:12345-0@lo:503: 00000100:00100000:2.0:1788638401.818593:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:5840:x1875523183595264:12345-0@lo:503: Request processed in 1559us (7306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638401.818606:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788638401.823434:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183595264:0@lo:503: 00000100:00100000:3.0:1788638401.825946:0:7953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7953:1875523183595392:0@lo:502: 00000100:00100000:3.0:1788638401.826034:0:7953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638401.826073:0:7953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73915f9480 going to sleep for 11 seconds 00000100:00100000:0.0:1788638401.827239:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183595392 00000100:00100000:0.0:1788638401.827255:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183595392 00000100:00100000:0.0:1788638401.827327:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788638401.827336:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:7953:x1875523183595392:12345-0@lo:502: 00000100:00100000:0.0:1788638401.827695:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:7953:x1875523183595392:12345-0@lo:502: Request processed in 358us (1660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638401.827704:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788638401.828128:0:7953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7953:1875523183595392:0@lo:502: 00000020:01000000:3.0:1788638401.828174:0:7953:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788638401.828184:0:7953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638401.828188:0:7953:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788638401.828197:0:7953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788638401.828199:0:7953:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788638401.828237:0:7953:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7953:1875523183595520:0@lo:502: 00000100:00100000:3.0:1788638401.828297:0:7953:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638401.828339:0:7953:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387973000 going to sleep for 11 seconds 00000100:00100000:2.0:1788638401.828392:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183595520 00000100:00100000:2.0:1788638401.828398:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183595520 00000100:00100000:2.0:1788638401.828438:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788638401.828457:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:7953:x1875523183595520:12345-0@lo:502: 00000100:00100000:2.0:1788638401.828610:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:7953:x1875523183595520:12345-0@lo:502: Request processed in 164us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638401.828618:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788638401.828989:0:7953:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7953:1875523183595520:0@lo:502: 00000020:01000000:3.0:1788638401.829012:0:7953:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638401.829017:0:7953:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638401.829019:0:7953:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788638401.829023:0:7953:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788638401.829357:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788638401.829384:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788638401.829394:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a74f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a756 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638401.829406:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a74f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a756 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638401.829427:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788638401.829430:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7387a11800 from 30 10000000:01000000:2.0:1788638401.829433:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788638401.829473:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2a75d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638401.829481:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2a75d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638401.829492:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2a75d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638401.829508:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183595648:0@lo:101: 00000100:00100000:2.0:1788638401.829545:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638401.829575:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788638401.829592:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183595648 00000100:00100000:2.0:1788638401.829596:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183595648 00000100:00100000:2.0:1788638401.829624:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788638401.829631:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:5840:x1875523183595648:12345-0@lo:101: 00010000:00010000:2.0:1788638401.829642:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638401.829655:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a764 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a75d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638401.829676:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a75d expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638401.829687:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a75d expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638401.829706:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6400, rc 0) 00000100:00100000:2.0:1788638401.829735:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:5840:x1875523183595648:12345-0@lo:101: Request processed in 104us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638401.829740:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788638401.829772:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183595648:0@lo:101: 00010000:00010000:2.0:1788638401.829803:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2a75d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a764 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638401.829823:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2a75d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a764 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638401.829863:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183595776:0@lo:501: 00000100:00100000:2.0:1788638401.829887:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638401.829900:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788638401.830035:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183595776 00000100:00100000:2.0:1788638401.830039:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183595776 00000100:00100000:2.0:1788638401.830060:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788638401.830066:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:5840:x1875523183595776:12345-0@lo:501: 00000100:00100000:2.0:1788638401.830340:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:5840:x1875523183595776:12345-0@lo:501: Request processed in 274us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638401.830347:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788638401.830995:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183595776:0@lo:501: 00000100:00100000:0.0:1788638401.831034:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b465b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183595904:0@lo:503: 00000100:00100000:0.0:1788638401.831090:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638401.831123:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384e6be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788638401.831318:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183595904 00000100:00100000:2.0:1788638401.831326:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183595904 00000100:00100000:2.0:1788638401.831366:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788638401.831373:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:5840:x1875523183595904:12345-0@lo:503: 00000100:00100000:2.0:1788638401.831543:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:5840:x1875523183595904:12345-0@lo:503: Request processed in 170us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638401.831556:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788638401.832992:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b465b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183595904:0@lo:503: 00000100:00100000:3.0:1788638401.838417:0:7954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7954:1875523183596032:0@lo:502: 00000100:00100000:3.0:1788638401.838495:0:7954:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638401.838544:0:7954:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73879730c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638401.838596:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183596032 00000100:00100000:2.0:1788638401.838602:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183596032 00000100:00100000:2.0:1788638401.838648:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788638401.838658:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:7954:x1875523183596032:12345-0@lo:502: 00000100:00100000:2.0:1788638401.839176:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:7954:x1875523183596032:12345-0@lo:502: Request processed in 518us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638401.839184:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788638401.839615:0:7954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7954:1875523183596032:0@lo:502: 00000100:00100000:3.0:1788638401.839667:0:7954:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7954:1875523183596160:0@lo:502: 00000100:00100000:3.0:1788638401.839705:0:7954:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638401.839773:0:7954:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73879730c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638401.840214:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183596160 00000100:00100000:2.0:1788638401.840220:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183596160 00000100:00100000:2.0:1788638401.840260:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788638401.840267:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:7954:x1875523183596160:12345-0@lo:502: 00000100:00100000:2.0:1788638401.840481:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:7954:x1875523183596160:12345-0@lo:502: Request processed in 213us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638401.840488:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788638401.840639:0:7954:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7954:1875523183596160:0@lo:502: 00000040:00080000:0.0:1788638401.840663:0:7954:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788638401.841023:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788638401.841041:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788638401.841051:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2a75d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a764 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638401.841062:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2a75d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a764 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638401.841072:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788638401.841075:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c7387a11800 from 5 10000000:01000000:2.0:1788638401.841078:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788638401.841104:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7200/0xa0b1f1e3b4b2a76b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638401.841123:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7200/0xa0b1f1e3b4b2a76b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638401.841133:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7200/0xa0b1f1e3b4b2a76b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638401.841148:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183596288:0@lo:101: 00000100:00100000:2.0:1788638401.841177:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638401.841214:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788638401.841494:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183596288 00000100:00100000:3.0:1788638401.841500:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183596288 00000100:00100000:3.0:1788638401.841537:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788638401.841545:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:5840:x1875523183596288:12345-0@lo:101: 00010000:00010000:3.0:1788638401.841554:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638401.841568:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73829f0600/0xa0b1f1e3b4b2a772 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a76b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638401.841589:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73829f0600/0xa0b1f1e3b4b2a772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a76b expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638401.841599:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73829f0600/0xa0b1f1e3b4b2a772 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a76b expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638401.841607:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73829f0600, rc 0) 00000100:00100000:3.0:1788638401.841652:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183596288:12345-0@lo:101: Request processed in 108us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638401.841659:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788638401.841725:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183596288:0@lo:101: 00010000:00010000:0.0:1788638401.841737:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7200/0xa0b1f1e3b4b2a76b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a772 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638401.841747:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7200/0xa0b1f1e3b4b2a76b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a772 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638401.841840:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b465b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183596416:0@lo:256: 00000100:00100000:0.0:1788638401.841874:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638401.841892:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c739b536300 going to sleep for 11 seconds 00000100:00100000:0.0:1788638401.841905:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183596416 00000100:00100000:0.0:1788638401.841908:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183596416 00000100:00100000:0.0:1788638401.841932:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788638401.841938:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183596416:12345-0@lo:256: 20000000:01000000:0.0:1788638401.841951:0:5834:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788638401.841966:0:5834:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788638401.841970:0:5834:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788638401.842041:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183596416:12345-0@lo:256: Request processed in 102us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638401.842048:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788638401.842079:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b465b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183596416:0@lo:256: 10000000:01000000:0.0:1788638401.842122:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788638401.842128:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7200/0xa0b1f1e3b4b2a76b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a772 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638401.842135:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7200/0xa0b1f1e3b4b2a76b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a772 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638401.842141:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788638401.842143:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788638401.842145:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788638401.842159:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638401.842165:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638401.842172:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a779 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638401.842181:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b465b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183596544:0@lo:101: 00000100:00100000:0.0:1788638401.842204:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638401.842215:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384e6b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788638401.842227:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183596544 00000100:00100000:0.0:1788638401.842230:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183596544 00000100:00100000:0.0:1788638401.842251:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788638401.842257:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183596544:12345-0@lo:101: 00010000:00010000:0.0:1788638401.842262:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638401.842270:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7380030c00/0xa0b1f1e3b4b2a780 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a779 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638401.842307:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7380030c00/0xa0b1f1e3b4b2a780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a779 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638401.842315:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7380030c00/0xa0b1f1e3b4b2a780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a779 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638401.842321:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030c00, rc 0) 00000100:00100000:0.0:1788638401.842347:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183596544:12345-0@lo:101: Request processed in 90us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638401.842353:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788638401.842383:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b465b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183596544:0@lo:101: 00010000:00010000:0.0:1788638401.842393:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a779 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a780 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638401.842400:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a779 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a780 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638401.842441:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b465b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183596672:0@lo:501: 00000100:00100000:0.0:1788638401.842463:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638401.842475:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384e6b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788638401.842485:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183596672 00000100:00100000:0.0:1788638401.842488:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183596672 00000100:00100000:0.0:1788638401.842504:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788638401.842508:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183596672:12345-0@lo:501: 00000100:00100000:0.0:1788638401.842739:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183596672:12345-0@lo:501: Request processed in 229us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638401.842745:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788638401.842776:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b465b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183596672:0@lo:501: 00000100:00100000:0.0:1788638401.842834:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b465b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183596800:0@lo:503: 00000100:00100000:0.0:1788638401.842874:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638401.842899:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384e6b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788638401.842910:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183596800 00000100:00100000:0.0:1788638401.842913:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183596800 00000100:00100000:0.0:1788638401.842933:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788638401.842939:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183596800:12345-0@lo:503: 00000100:00100000:0.0:1788638401.843243:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183596800:12345-0@lo:503: Request processed in 304us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638401.843250:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788638401.843297:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b465b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183596800:0@lo:503: 00000100:00100000:0.0:1788638401.846254:0:7955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b465b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7955:1875523183596928:0@lo:502: 00000100:00100000:0.0:1788638401.846346:0:7955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638401.846384:0:7955:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398bea3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638401.846439:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183596928 00000100:00100000:2.0:1788638401.846447:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183596928 00000100:00100000:2.0:1788638401.846493:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788638401.846502:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:7955:x1875523183596928:12345-0@lo:502: 00000100:00100000:2.0:1788638401.846886:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:7955:x1875523183596928:12345-0@lo:502: Request processed in 385us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638401.846894:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788638401.847160:0:7955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b465b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7955:1875523183596928:0@lo:502: 00000020:01000000:0.0:1788638401.847190:0:7955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788638401.847197:0:7955:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788638401.847204:0:7955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638401.847207:0:7955:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788638401.847212:0:7955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788638401.847216:0:7955:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.134@tcp to nid 0x20000c0a8cb86 (192.168.203.134@tcp) 00000020:01000000:0.0:1788638401.847237:0:7955:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788638401.847240:0:7955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788638401.847254:0:7955:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c73bce3cd40) 00000020:00000080:0.0:1788638401.847276:0:7955:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788638401.847301:0:7955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788638401.847379:0:7955:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788638401.847384:0:7955:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788638401.847393:0:7955:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa0b1f1e3b4b2a78e 00010000:00080000:0.0:1788638401.847421:0:7955:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c73bf0e8000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.134@tcp at head 00010000:00010000:0.0:1788638401.847657:0:7955:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788638401.848746:0:7955:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788638401.848758:0:7955:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788638401.849320:0:7955:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788638401.849534:0:7955:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788638401.849588:0:7955:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788638401.849650:0:7955:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788638401.851097:0:7956:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788638401.851103:0:7956:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788638401.851632:0:7955:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788638401.851643:0:7955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788638401.851673:0:7955:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788638401.851692:0:7955:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa0b1f1e3b4b2a795 00000100:00080000:2.0:1788638401.851701:0:7955:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788638401.851707:0:7955:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c73bf0e8000 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:2.0:1788638401.851738:0:7955:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73837d5180 x1875523183597056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788638401.851844:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183597056:0@lo:8: 00000100:00100000:3.0:1788638401.851973:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638401.852119:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183597056 00000100:00100000:0.0:1788638401.852126:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183597056 00000100:00100000:0.0:1788638401.852188:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788638401.852195:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3290:x1875523183597056:12345-0@lo:8: 00010000:00080000:0.0:1788638401.852219:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:0.0:1788638401.852251:0:6687:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa0b1f1e3b4b2a79c 00002000:00100000:0.0:1788638401.852264:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c72833bd800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788638401.852268:0:6687:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1788638401.852271:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788638401.852391:0:6687:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788638401.852520:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788638401.852540:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9c72833bd000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788638401.852594:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3290:x1875523183597056:12345-0@lo:8: Request processed in 397us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638401.852601:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788638401.852659:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73837d5180 x1875523183597056/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788638411 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638401.852669:0:3290:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788638401.852681:0:3290:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788638401.852687:0:3290:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788638401.852691:0:3290:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788638401.852693:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73bf0e8000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788638401.852706:0:3290:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788638401.852711:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183597056:0@lo:8: 00000004:00080000:0.0:1788638401.852771:0:7956:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788638401.852983:0:7956:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 164924199099ns, next at 0ns, rc = 0 00000100:00080000:0.0:1788638401.853034:0:7955:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1788638401.853094:0:7955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638401.853098:0:7955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638401.853100:0:7955:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788638401.853103:0:7955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788638401.853107:0:7955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638401.853108:0:7955:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788638401.853111:0:7955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788638401.853113:0:7955:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788638401.853135:0:7955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b465b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7955:1875523183597184:0@lo:502: 00000100:00100000:0.0:1788638401.853178:0:7955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638401.853198:0:7955:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398beac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788638401.853318:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183597696:0@lo:400: 00000100:00100000:2.0:1788638401.853350:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638401.853379:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788638401.853385:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183597312:0@lo:400: 00000100:00100000:2.0:1788638401.853407:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638401.853436:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183597696 00000100:00100000:2.0:1788638401.853441:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183597696 00000100:00100000:2.0:1788638401.853474:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183597312 00000100:00100000:2.0:1788638401.853477:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183597312 00000100:00100000:2.0:1788638401.853497:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788638401.853504:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183597696:12345-0@lo:400: 00000100:00100000:2.0:1788638401.853543:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183597696:12345-0@lo:400: Request processed in 39us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638401.853550:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788638401.853562:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788638401.853568:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183597312:12345-0@lo:400: 00000100:00100000:2.0:1788638401.853592:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183597312:12345-0@lo:400: Request processed in 24us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638401.853597:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1788638401.853630:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73837d4000 x1875523183597312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638401.853641:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183597312:0@lo:400: 00010000:00080000:2.0:1788638401.853651:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73837d7100 x1875523183597696/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638401.853658:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183597696:0@lo:400: 00000100:00100000:2.0:1788638401.853679:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183597184 00000100:00100000:2.0:1788638401.853682:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183597184 00000100:00100000:2.0:1788638401.853706:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788638401.853713:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:7955:x1875523183597184:12345-0@lo:502: 00000100:00100000:2.0:1788638401.854338:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:7955:x1875523183597184:12345-0@lo:502: Request processed in 624us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638401.854346:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788638401.854383:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183597440:0@lo:400: 00000100:00100000:1.0:1788638401.854414:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638401.854446:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183597568:0@lo:400: 00000100:00100000:3.0:1788638401.854476:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638401.854794:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183597568 00000100:00100000:2.0:1788638401.854800:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183597568 00000100:00100000:2.0:1788638401.854840:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788638401.854847:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183597568:12345-0@lo:400: 00000100:00100000:2.0:1788638401.854887:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183597568:12345-0@lo:400: Request processed in 41us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638401.854893:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788638401.854977:0:7955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b465b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:7955:1875523183597184:0@lo:502: 00000020:01000000:0.0:1788638401.855005:0:7955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638401.855012:0:7955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638401.855013:0:7955:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788638401.855018:0:7955:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00080000:2.0:1788638401.855198:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788638401.855218:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73837d7480 x1875523183597568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638401.855230:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183597568:0@lo:400: 00000100:00100000:2.0:1788638401.855252:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183597440 00000100:00100000:2.0:1788638401.855256:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183597440 00000100:00100000:2.0:1788638401.855340:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788638401.855348:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183597440:12345-0@lo:400: 00000100:00100000:2.0:1788638401.855387:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183597440:12345-0@lo:400: Request processed in 40us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638401.855394:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1788638401.855418:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73837d6d80 x1875523183597440/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638417 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638401.855428:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183597440:0@lo:400: 00000020:01000000:2.0:1788638401.855448:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1788638401.855465:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788638401.855480:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a779 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a780 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638401.855490:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a780 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638401.855501:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788638401.855504:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c738375b380 from 1 10000000:01000000:2.0:1788638401.855507:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788638401.855531:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a7a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638401.855539:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a7a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638401.855548:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a7a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638401.855562:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183597824:0@lo:101: 00000100:00100000:2.0:1788638401.855590:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638401.855615:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788638401.855629:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183597824 00000100:00100000:2.0:1788638401.855632:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183597824 00000100:00100000:2.0:1788638401.855654:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788638401.855661:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183597824:12345-0@lo:101: 00010000:00010000:2.0:1788638401.855669:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638401.855681:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a7aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a7a3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638401.855703:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a7aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a7a3 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638401.855720:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a7aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a7a3 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638401.855729:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6c00, rc 0) 00000100:00100000:2.0:1788638401.855753:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:5840:x1875523183597824:12345-0@lo:101: Request processed in 93us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638401.855759:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788638401.856167:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183597824:0@lo:101: 00010000:00010000:2.0:1788638401.856179:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a7a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a7aa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638401.856189:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a7a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a7aa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638401.856232:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183597952:0@lo:501: 00000100:00100000:2.0:1788638401.856258:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638401.856276:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304a600 going to sleep for 11 seconds 00000100:00100000:2.0:1788638401.856452:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183597952 00000100:00100000:2.0:1788638401.856456:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183597952 00000100:00100000:2.0:1788638401.856478:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788638401.856485:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:5840:x1875523183597952:12345-0@lo:501: 00000100:00100000:2.0:1788638401.856704:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:5840:x1875523183597952:12345-0@lo:501: Request processed in 218us (444us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788638401.856712:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788638401.856744:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183597952:0@lo:501: 10000000:01000000:2.0:1788638401.856764:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788638401.856776:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a7a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a7aa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638401.856802:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a7a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a7aa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788638401.920990:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1788638401.960815:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788638401.960841:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183598080:0@lo:13: 00000100:00100000:3.0:1788638401.960920:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638401.960990:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183598080 00000100:00100000:3.0:1788638401.960997:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183598080 00000100:00100000:3.0:1788638401.961057:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788638401.961068:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1875523183598080:12345-0@lo:13: 00002000:00000024:3.0:1788638401.961103:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1788638401.961151:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1875523183598080:12345-0@lo:13: Request processed in 85us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638401.961158:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788638401.961179:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788638401.961208:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73acdcbb80 x1875523183598080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638417 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638401.961226:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183598080:0@lo:13: 00000004:00080000:3.0:1788638401.961376:0:7957:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788638401.961399:0:7957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7957:1875523183598208:0@lo:7: 00000100:00100000:3.0:1788638401.961427:0:7957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638401.961471:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183598208 00000100:00100000:3.0:1788638401.961475:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183598208 00000100:00100000:3.0:1788638401.961509:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788638401.961519:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7957:x1875523183598208:12345-0@lo:7: 00000100:00100000:1.0:1788638401.965903:0:7957:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7385610180 going to sleep for 11 seconds 00002000:00080000:3.0:1788638401.973177:0:6687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1788638401.973187:0:6687:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788638401.973390:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7957:x1875523183598208:12345-0@lo:7: Request processed in 11869us (11958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638401.973402:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788638401.973483:0:7957:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73acdcbb80 x1875523183598208/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788638417 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638401.973499:0:7957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7957:1875523183598208:0@lo:7: 00000004:00080000:0.0:1788638401.973514:0:7957:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788638401.973554:0:7957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b465b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7957:1875523183598336:0@lo:5: 00000100:00100000:0.0:1788638401.973592:0:7957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638401.973670:0:7957:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398bea600 going to sleep for 11 seconds 00000100:00100000:2.0:1788638401.973703:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183598336 00000100:00100000:2.0:1788638401.973710:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183598336 00000100:00100000:2.0:1788638401.973843:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788638401.973853:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b465b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7957:x1875523183598336:12345-0@lo:5: 00002000:00080000:2.0:1788638401.973880:0:6684:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788638401.973884:0:6684:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788638401.974296:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b465b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7957:x1875523183598336:12345-0@lo:5: Request processed in 444us (702us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788638401.974304:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788638401.980397:0:7957:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b465b100 x1875523183598336/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788638417 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638401.980419:0:7957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b465b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7957:1875523183598336:0@lo:5: 00000004:00080000:0.0:1788638401.980445:0:7957:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788638401.980575:0:7957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdcbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7957:1875523183598464:0@lo:700: 00000100:00100000:3.0:1788638401.980634:0:7957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638401.980716:0:7957:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73984fd840 going to sleep for 11 seconds 00000100:00100000:0.0:1788638401.981147:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183598464 00000100:00100000:0.0:1788638401.981154:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183598464 00000100:00100000:0.0:1788638401.981357:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638401.981369:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7957:x1875523183598464:12345-0@lo:700: 00000100:00100000:0.0:1788638401.981407:0:6693:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b465bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6693:1875523183598592:0@lo:700: 00000100:00100000:0.0:1788638401.981442:0:6693:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638401.981507:0:6693:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398bea600 going to sleep for 11 seconds 00000100:00100000:3.0:1788638401.981556:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183598592 00000100:00100000:3.0:1788638401.981561:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183598592 00000100:00100000:3.0:1788638401.981627:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788638401.981634:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6693:x1875523183598592:12345-0@lo:700: 40000000:02000000:3.0:1788638402.092704:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1788638402.107567:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4658000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6693:x1875523183598592:12345-0@lo:700: Request processed in 125924us (126114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638402.107582:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788638402.107738:0:6693:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b465bb80 x1875523183598592/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788638417 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638402.107753:0:6693:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b465bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6693:1875523183598592:0@lo:700: 40000000:02000000:3.0:1788638402.107767:0:6693:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:1.0:1788638402.181083:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788638402.181111:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:2.0:1788638402.181155:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7957:x1875523183598464:12345-0@lo:700: Request processed in 199785us (200518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638402.181169:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788638402.181176:0:7957:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73acdcbb80 x1875523183598464/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788638417 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638402.181205:0:7957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdcbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7957:1875523183598464:0@lo:700: 00000004:02000040:1.0:1788638402.223321:0:7957:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1788638402.228602:0:7957:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7957:1875523183598720:0@lo:5: 00000100:00100000:1.0:1788638402.228676:0:7957:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638402.228825:0:7957:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32300 going to sleep for 11 seconds 00000100:00100000:0.0:1788638402.230421:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183598720 00000100:00100000:0.0:1788638402.230433:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183598720 00000100:00100000:0.0:1788638402.230626:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788638402.230639:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7957:x1875523183598720:12345-0@lo:5: 00002000:00080000:3.0:1788638402.251368:0:6687:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788638402.251394:0:6687:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788638402.286176:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7957:x1875523183598720:12345-0@lo:5: Request processed in 55532us (57492us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788638402.286190:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788638402.286438:0:7957:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73ad30f100 x1875523183598720/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788638418 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638402.286452:0:7957:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788638402.286468:0:7957:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c73ad30f100 x1875523183598720/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788638418 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638402.286480:0:7957:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7957:1875523183598720:0@lo:5: 00000004:00080000:1.0:1788638402.286568:0:7957:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000001:02000400:2.0:1788638402.344680:0:7999:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg334-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788638402.464111:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638403.499740:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638404.511954:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638404.833903:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788638404.833928:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183598848:0@lo:13: 00000100:00100000:3.0:1788638404.834008:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638404.834445:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183598848 00000100:00100000:0.0:1788638404.834454:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183598848 00000100:00100000:0.0:1788638404.834523:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788638404.834533:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183598848:12345-0@lo:13: 00002000:00000024:0.0:1788638404.834573:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638404.834644:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183598848:12345-0@lo:13: Request processed in 112us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638404.834652:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788638404.835503:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788638404.835547:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b4659180 x1875523183598848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638404.835570:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4659180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183598848:0@lo:13: 00010000:00010000:1.0:1788638405.536009:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638406.560075:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638406.882703:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183599360:0@lo:400: 00000100:00100000:2.0:1788638406.882808:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638406.882884:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788638406.882891:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183598976:0@lo:400: 00000100:00100000:2.0:1788638406.882920:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638406.882944:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1875523183599488:0@lo:400: 00000100:00100000:2.0:1788638406.882968:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638406.882996:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183599104:0@lo:400: 00000100:00100000:2.0:1788638406.883035:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638406.883053:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183599616:0@lo:400: 00000100:00100000:2.0:1788638406.883098:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638406.883114:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788638406.883119:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183599232:0@lo:400: 00000100:00100000:2.0:1788638406.883137:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638406.883169:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183599360 00000100:00100000:2.0:1788638406.883177:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183599360 00000100:00100000:1.0:1788638406.883323:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183599616 00000100:00100000:1.0:1788638406.883328:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183599616 00000100:00100000:2.0:1788638406.884118:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788638406.884132:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183599360:12345-0@lo:400: 00000100:00100000:2.0:1788638406.884198:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183599360:12345-0@lo:400: Request processed in 71us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638406.884206:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788638406.887201:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183599488 00000100:00100000:0.0:1788638406.887219:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183599488 00000100:00100000:0.0:1788638406.887298:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183599104 00000100:00100000:0.0:1788638406.887302:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183599104 00000100:00080000:3.0:1788638406.887737:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788638406.887744:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788638406.887748:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788638406.887832:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73837d4000 x1875523183599360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638406.887849:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183599360:0@lo:400: 00000100:00100000:1.0:1788638406.888114:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788638406.888128:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3293:x1875523183599616:12345-0@lo:400: 00000100:00100000:1.0:1788638406.888216:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3293:x1875523183599616:12345-0@lo:400: Request processed in 94us (5117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638406.888223:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788638406.890075:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183599232 00000100:00100000:0.0:1788638406.890082:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183599232 00000100:00100000:0.0:1788638406.890113:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788638406.890121:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875523183599488:12345-0@lo:400: 00000100:00100000:0.0:1788638406.890204:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875523183599488:12345-0@lo:400: Request processed in 84us (7234us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638406.890211:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788638406.890226:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788638406.890232:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183599104:12345-0@lo:400: 00000100:00100000:0.0:1788638406.890275:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183599104:12345-0@lo:400: Request processed in 44us (7239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638406.890281:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788638406.890293:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788638406.890299:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183599232:12345-0@lo:400: 00000100:00100000:0.0:1788638406.890383:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183599232:12345-0@lo:400: Request processed in 85us (7245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638406.890389:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788638406.890426:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183598976 00000100:00100000:0.0:1788638406.890431:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183598976 00000100:00100000:0.0:1788638406.890464:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788638406.890471:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3291:x1875523183598976:12345-0@lo:400: 00000100:00100000:0.0:1788638406.890502:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3291:x1875523183598976:12345-0@lo:400: Request processed in 31us (7581us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638406.890508:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1788638406.890540:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638406.891072:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183598976:0@lo:400: 00010000:00080000:3.0:1788638406.891090:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73837d6a00 x1875523183599488/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638406.891100:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1875523183599488:0@lo:400: 00010000:00080000:1.0:1788638406.894327:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73837d7800 x1875523183599616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638406.894349:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183599616:0@lo:400: 00010000:00080000:1.0:1788638406.894410:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73837d7100 x1875523183599232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638406.894420:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183599232:0@lo:400: 00010000:00080000:1.0:1788638406.894434:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73837d7480 x1875523183599104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638422 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638406.894442:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183599104:0@lo:400: 00000100:00100000:1.0:1788638407.394424:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788638407.394462:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183599744:0@lo:13: 00000100:00100000:1.0:1788638407.394529:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638407.395116:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183599744 00000100:00100000:0.0:1788638407.395125:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183599744 00000100:00100000:0.0:1788638407.395188:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788638407.395197:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1875523183599744:12345-0@lo:13: 00002000:00000024:0.0:1788638407.395235:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638407.395299:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3293:x1875523183599744:12345-0@lo:13: Request processed in 102us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638407.395307:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788638407.395497:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73ad30f480 x1875523183599744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638423 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638407.395519:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183599744:0@lo:13: 00000001:00080000:2.0:1788638407.547596:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1788638407.584807:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638408.195620:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638408.199874:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174137984 00000100:00100000:0.0:1788638408.199889:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174137984 00000100:00100000:0.0:1788638408.200128:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 113 00000100:00100000:0.0:1788638408.200136:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2363:x1875523174137984:12345-192.168.203.34@tcp:250: 00010000:00080000:0.0:1788638408.200165:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 55273f9a-386c-4321-9748-c194b047efe8@192.168.203.34@tcp t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:0.0:1788638408.200196:0:5837:0:(genops.c:1385:class_connect()) connect: client 55273f9a-386c-4321-9748-c194b047efe8, cookie 0xa0b1f1e3b4b2a7b1 00000100:00080000:0.0:1788638408.200377:0:5837:0:(import.c:65:import_set_state_nolock()) ffff9c72833ba800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788638408.200456:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+5:2363:x1875523174137984:12345-192.168.203.34@tcp:250: Request processed in 319us (4845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638408.200465:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 113 00000100:00100000:0.0:1788638408.207841:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638408.207890:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174138112 00000100:00100000:1.0:1788638408.207916:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174138112 00000100:00100000:1.0:1788638408.208073:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 114 00000100:00100000:1.0:1788638408.208084:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+5:5594:x1875523174138112:12345-192.168.203.34@tcp:101: 00010000:00010000:1.0:1788638408.208104:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638408.208123:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a7b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434cbe expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638408.208153:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a7b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cbe expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638408.208175:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a7b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cbe expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638408.208185:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7381684a00, rc 0) 00000100:00100000:1.0:1788638408.208628:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+6:5594:x1875523174138112:12345-192.168.203.34@tcp:101: Request processed in 544us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638408.208648:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 114 00000100:00100000:0.0:1788638408.219703:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638408.219854:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174138240 00000100:00100000:1.0:1788638408.219864:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174138240 00000100:00100000:1.0:1788638408.220046:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 115 00000100:00100000:1.0:1788638408.220057:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+6:5594:x1875523174138240:12345-192.168.203.34@tcp:501: 00000100:00100000:1.0:1788638408.220460:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+6:5594:x1875523174138240:12345-192.168.203.34@tcp:501: Request processed in 404us (766us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788638408.220468:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 115 00000100:00100000:1.0:1788638408.222531:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638408.224165:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174138368 00000100:00100000:0.0:1788638408.224178:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174138368 00000100:00100000:0.0:1788638408.224276:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 116 00000100:00100000:0.0:1788638408.224288:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+6:5594:x1875523174138368:12345-192.168.203.34@tcp:101: 00010000:00010000:0.0:1788638408.224306:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638408.224332:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a7bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434cc5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638408.224359:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a7bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cc5 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638408.224370:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a7bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cc5 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638408.224380:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031c00, rc 0) 00000100:00100000:0.0:1788638408.224441:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+7:5594:x1875523174138368:12345-192.168.203.34@tcp:101: Request processed in 156us (1916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638408.224448:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 116 00000100:00100000:0.0:1788638408.228593:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638408.229434:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174138496 00000100:00100000:1.0:1788638408.229445:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174138496 00000100:00100000:1.0:1788638408.229502:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 117 00000100:00100000:1.0:1788638408.229513:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+7:5594:x1875523174138496:12345-192.168.203.34@tcp:501: 00000100:00100000:1.0:1788638408.229744:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+8:5594:x1875523174138496:12345-192.168.203.34@tcp:501: Request processed in 232us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638408.229751:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 117 00000100:00100000:0.0:1788638408.243283:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638408.244093:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174138624 00000100:00100000:2.0:1788638408.244104:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174138624 00000100:00100000:2.0:1788638408.244211:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 118 00000100:00100000:2.0:1788638408.244455:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+8:5594:x1875523174138624:12345-192.168.203.34@tcp:503: 00000100:00100000:2.0:1788638408.245192:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+8:5594:x1875523174138624:12345-192.168.203.34@tcp:503: Request processed in 739us (1915us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638408.245202:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 118 00000100:00100000:2.0:1788638408.257284:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638408.259328:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174138752 00000100:00100000:3.0:1788638408.259343:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174138752 00000100:00100000:3.0:1788638408.259405:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 119 00000100:00100000:3.0:1788638408.259416:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+8:5613:x1875523174138752:12345-192.168.203.34@tcp:502: 00000100:00100000:3.0:1788638408.259877:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+8:5613:x1875523174138752:12345-192.168.203.34@tcp:502: Request processed in 462us (2609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638408.259887:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 119 00000100:00100000:3.0:1788638408.305596:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638408.305700:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174138880 00000100:00100000:2.0:1788638408.305712:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174138880 00000100:00100000:2.0:1788638408.305773:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 120 00000100:00100000:2.0:1788638408.305823:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+8:5613:x1875523174138880:12345-192.168.203.34@tcp:502: 00000100:00100000:2.0:1788638408.306898:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+8:5613:x1875523174138880:12345-192.168.203.34@tcp:502: Request processed in 418us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638408.306909:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 120 00000100:00100000:1.0:1788638408.315908:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638408.318186:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174139008 00000100:00100000:3.0:1788638408.318210:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174139008 00000100:00100000:3.0:1788638408.318276:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 121 00000100:00100000:3.0:1788638408.318287:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+8:5594:x1875523174139008:12345-192.168.203.34@tcp:101: 00010000:00010000:3.0:1788638408.318305:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638408.318324:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73829f0200/0xa0b1f1e3b4b2a7c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434cef expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638408.318351:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73829f0200/0xa0b1f1e3b4b2a7c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cef expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638408.318364:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73829f0200/0xa0b1f1e3b4b2a7c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cef expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638408.318373:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73829f0200, rc 0) 00000100:00100000:3.0:1788638408.318450:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+9:5594:x1875523174139008:12345-192.168.203.34@tcp:101: Request processed in 165us (2552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638408.318457:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 121 00000100:00100000:2.0:1788638408.323560:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638408.323595:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174139136 00000100:00100000:2.0:1788638408.323605:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174139136 00000100:00100000:2.0:1788638408.323663:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 122 00000100:00100000:2.0:1788638408.323673:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+9:5594:x1875523174139136:12345-192.168.203.34@tcp:256: 20000000:01000000:2.0:1788638408.323699:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788638408.323718:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788638408.323723:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788638408.323726:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788638408.323728:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788638408.333932:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+9:5594:x1875523174139136:12345-192.168.203.34@tcp:256: Request processed in 10250us (10372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638408.333949:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 122 00000100:00100000:0.0:1788638408.338629:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638408.341042:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174139264 00000100:00100000:3.0:1788638408.341056:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174139264 00000100:00100000:3.0:1788638408.341106:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 123 00000100:00100000:3.0:1788638408.341117:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+9:5594:x1875523174139264:12345-192.168.203.34@tcp:101: 00010000:00010000:3.0:1788638408.341135:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638408.341153:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73829f1200/0xa0b1f1e3b4b2a7cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434cf6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638408.341194:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73829f1200/0xa0b1f1e3b4b2a7cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cf6 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638408.341205:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73829f1200/0xa0b1f1e3b4b2a7cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cf6 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638408.341215:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73829f1200, rc 0) 00000100:00100000:3.0:1788638408.341293:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+10:5594:x1875523174139264:12345-192.168.203.34@tcp:101: Request processed in 178us (2672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638408.341300:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 123 00000100:00100000:2.0:1788638408.347514:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638408.348648:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174139392 00000100:00100000:3.0:1788638408.348661:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174139392 00000100:00100000:3.0:1788638408.348715:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 124 00000100:00100000:3.0:1788638408.348726:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+10:5594:x1875523174139392:12345-192.168.203.34@tcp:501: 00000100:00100000:3.0:1788638408.349023:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+10:5594:x1875523174139392:12345-192.168.203.34@tcp:501: Request processed in 298us (1518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638408.349032:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 124 00000100:00100000:2.0:1788638408.361186:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638408.361246:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174139520 00000100:00100000:2.0:1788638408.361255:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174139520 00000100:00100000:2.0:1788638408.361303:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 125 00000100:00100000:2.0:1788638408.361313:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+10:5594:x1875523174139520:12345-192.168.203.34@tcp:503: 00000100:00100000:2.0:1788638408.361660:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+10:5594:x1875523174139520:12345-192.168.203.34@tcp:503: Request processed in 347us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638408.361668:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 125 00000100:00100000:0.0:1788638408.374495:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638408.375006:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174139648 00000100:00100000:3.0:1788638408.375016:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174139648 00000100:00100000:3.0:1788638408.375075:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 126 00000100:00100000:3.0:1788638408.375085:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+10:5618:x1875523174139648:12345-192.168.203.34@tcp:502: 00000100:00100000:3.0:1788638408.375742:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+10:5618:x1875523174139648:12345-192.168.203.34@tcp:502: Request processed in 655us (1255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638408.375751:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 126 00000100:00100000:2.0:1788638408.383207:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638408.383249:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174139776 00000100:00100000:2.0:1788638408.383259:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174139776 00000100:00100000:2.0:1788638408.383309:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 127 00000100:00100000:2.0:1788638408.383320:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+10:5618:x1875523174139776:12345-192.168.203.34@tcp:502: 00000100:00100000:2.0:1788638408.383568:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+10:5618:x1875523174139776:12345-192.168.203.34@tcp:502: Request processed in 250us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638408.383576:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 127 00000100:00100000:3.0:1788638408.387877:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638408.387931:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174139904 00000100:00100000:3.0:1788638408.387939:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174139904 00000100:00100000:3.0:1788638408.387981:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 4 00000100:00100000:3.0:1788638408.387989:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2363:x1875523174139904:12345-192.168.203.34@tcp:38: 00010000:00080000:3.0:1788638408.388018:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp t0 exp 0000000000000000 cur 171 last 0 00000020:00000080:3.0:1788638408.388065:0:5843:0:(genops.c:1385:class_connect()) connect: client 00196f64-ae55-4ffc-b84c-468028ab3a77, cookie 0xa0b1f1e3b4b2a7d4 00000004:00100000:3.0:1788638408.388101:0:5843:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:3.0:1788638408.388108:0:5843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788638408.429879:0:5843:0:(import.c:65:import_set_state_nolock()) ffff9c73ad476800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788638408.429961:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2363:x1875523174139904:12345-192.168.203.34@tcp:38: Request processed in 41970us (42092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638408.429974:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 4 00010000:00010000:1.0:1788638408.610395:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638408.932229:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638408.932408:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174140160 00000100:00100000:0.0:1788638408.932418:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174140160 00000100:00100000:0.0:1788638408.932513:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 5 00000100:00100000:0.0:1788638408.932525:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+6:5594:x1875523174140160:12345-192.168.203.34@tcp:41: 00000004:00000024:0.0:1788638408.932571:0:7634:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788638408.932639:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+6:5594:x1875523174140160:12345-192.168.203.34@tcp:41: Request processed in 117us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638408.932646:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 5 00000100:00080000:3.0:1788638408.933176:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638408.936418:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638408.936543:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174140288 00000100:00100000:3.0:1788638408.936552:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174140288 00000100:00100000:3.0:1788638408.936613:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00100000:3.0:1788638408.936624:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:5594:x1875523174140288:12345-192.168.203.34@tcp:40: 00000100:00100000:3.0:1788638408.936710:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:5594:x1875523174140288:12345-192.168.203.34@tcp:40: Request processed in 88us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638408.936717:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00100000:0.0:1788638408.938583:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638408.940367:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638408.940558:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174140672 00000100:00100000:3.0:1788638408.940567:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174140672 00000100:00100000:3.0:1788638408.940624:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 0 00000100:00100000:3.0:1788638408.940633:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:5594:x1875523174140672:12345-192.168.203.34@tcp:33: 00000100:00100000:2.0:1788638408.941883:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174140032 00000100:00100000:2.0:1788638408.941891:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174140032 00000100:00100000:2.0:1788638408.941933:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 7 00000100:00100000:2.0:1788638408.941941:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b465a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+7:0:x1875523174140032:12345-192.168.203.34@tcp:41: 00000004:00000024:2.0:1788638408.941960:0:7634:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788638408.942025:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b465a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+7:0:x1875523174140032:12345-192.168.203.34@tcp:41: Request processed in 84us (3447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638408.942031:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 7 00000100:00100000:2.0:1788638408.944367:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638408.944413:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638408.944527:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174140416 00000100:00100000:0.0:1788638408.944548:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174140416 00000100:00100000:0.0:1788638408.944583:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174140544 00000100:00100000:0.0:1788638408.944586:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174140544 00000100:00100000:0.0:1788638408.944600:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:0.0:1788638408.944608:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2363:x1875523174140416:12345-192.168.203.34@tcp:8: 00010000:00080000:0.0:1788638408.944638:0:6686:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:0.0:1788638408.944668:0:6686:0:(genops.c:1385:class_connect()) connect: client 00196f64-ae55-4ffc-b84c-468028ab3a77, cookie 0xa0b1f1e3b4b2a7db 00002000:00100000:0.0:1788638408.944681:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 00196f64-ae55-4ffc-b84c-468028ab3a77/ffff9c72833b9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788638408.944710:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:0.0:1788638408.945115:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788638408.945144:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9c72833bf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788638408.945220:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2363:x1875523174140416:12345-192.168.203.34@tcp:8: Request processed in 612us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638408.945228:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:0.0:1788638408.945258:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:0.0:1788638408.945263:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2363:x1875523174140544:12345-192.168.203.34@tcp:8: 00010000:00080000:0.0:1788638408.945278:0:6686:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:0.0:1788638408.945296:0:6686:0:(genops.c:1385:class_connect()) connect: client 00196f64-ae55-4ffc-b84c-468028ab3a77, cookie 0xa0b1f1e3b4b2a7e2 00002000:00100000:0.0:1788638408.945302:0:6686:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 00196f64-ae55-4ffc-b84c-468028ab3a77/ffff9c72833b9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788638408.945317:0:6686:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:0.0:1788638408.945599:0:6686:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788638408.945616:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9c72833be800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788638408.945642:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2363:x1875523174140544:12345-192.168.203.34@tcp:8: Request processed in 377us (1228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638408.945648:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 9 00000004:00080000:0.0:1788638408.959757:0:5845:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 19050us 00000004:00200000:0.0:1788638408.970217:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788638408.970364:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:5594:x1875523174140672:12345-192.168.203.34@tcp:33: Request processed in 29726us (29998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638408.970391:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 0 00000100:00100000:2.0:1788638409.228690:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638409.229096:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174140800 00000100:00100000:3.0:1788638409.229106:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174140800 00000100:00100000:3.0:1788638409.229168:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:3.0:1788638409.229202:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:5635:x1875523174140800:12345-192.168.203.34@tcp:101: 00010000:00010000:3.0:1788638409.229228:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638409.229263:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a7e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434d20 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638409.229337:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73829f1a00/0xa0b1f1e3b4b2a7f0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638409.229351:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73829f1a00/0xa0b1f1e3b4b2a7f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638409.229368:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73829f1a00/0xa0b1f1e3b4b2a7f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638409.229408:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788638409.229412:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788638409.229432:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73829f1a00/0xa0b1f1e3b4b2a7f0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638409.229462:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a7e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d20 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638409.229481:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73829f1a00/0xa0b1f1e3b4b2a7f0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d20 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638409.229490:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7393e81200) 00010000:00010000:3.0:1788638409.229493:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788638409.229496:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73829f1a00, rc 0) 00000100:00100000:3.0:1788638409.229566:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+7:5635:x1875523174140800:12345-192.168.203.34@tcp:101: Request processed in 376us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638409.229583:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 8 00010000:00010000:1.0:1788638409.632043:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638409.952357:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788638409.952395:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b465a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183599872:0@lo:13: 00000100:00100000:2.0:1788638409.952479:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638409.952595:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183599872 00000100:00100000:0.0:1788638409.952603:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183599872 00000100:00100000:0.0:1788638409.952671:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788638409.952680:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183599872:12345-0@lo:13: 00002000:00000024:0.0:1788638409.952710:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638409.952758:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183599872:12345-0@lo:13: Request processed in 79us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638409.952766:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788638409.952824:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b465a300 x1875523183599872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638409.952842:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b465a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183599872:0@lo:13: 00000100:00080000:2.0:1788638409.952903:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1788638410.019553:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 00196f64-ae55-4ffc-b84c-468028ab3a77 00010000:00010000:1.0:1788638410.659292:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638411.680121:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638411.745277:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638411.745385:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174140928 00000100:00100000:2.0:1788638411.745395:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174140928 00000100:00100000:2.0:1788638411.745488:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:2.0:1788638411.745507:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b465a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+7:5687:x1875523174140928:12345-192.168.203.34@tcp:41: 00000004:00000024:2.0:1788638411.745561:0:7634:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00080000:3.0:1788638411.745766:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638411.746030:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b465a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+7:5687:x1875523174140928:12345-192.168.203.34@tcp:41: Request processed in 531us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638411.746038:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:1.0:1788638411.758695:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638411.762132:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174141056 00000100:00100000:0.0:1788638411.762147:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174141056 00000100:00080000:3.0:1788638411.762321:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788638411.762768:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:0.0:1788638411.762780:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:00196f64-ae55-4ffc-b84c-468028ab3a77+5:5687:x1875523174141056:12345-192.168.203.34@tcp:13: 00002000:00000024:0.0:1788638411.762843:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638411.762929:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:00196f64-ae55-4ffc-b84c-468028ab3a77+5:5687:x1875523174141056:12345-192.168.203.34@tcp:13: Request processed in 151us (4245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638411.762936:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:0.0:1788638411.766266:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638411.766642:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174141184 00000100:00100000:1.0:1788638411.766651:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174141184 00000100:00100000:1.0:1788638411.766724:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:1.0:1788638411.766734:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:00196f64-ae55-4ffc-b84c-468028ab3a77+6:5687:x1875523174141184:12345-192.168.203.34@tcp:13: 00002000:00000024:1.0:1788638411.766820:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788638411.766903:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4658380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:00196f64-ae55-4ffc-b84c-468028ab3a77+6:5687:x1875523174141184:12345-192.168.203.34@tcp:13: Request processed in 170us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638411.766910:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00080000:3.0:1788638411.767103:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788638412.000374:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1875523183600256:0@lo:400: 00000100:00100000:0.0:1788638412.000450:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638412.000516:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788638412.000522:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b465aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183600128:0@lo:400: 00000100:00100000:0.0:1788638412.000547:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638412.000567:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183600640:0@lo:400: 00000100:00100000:0.0:1788638412.000591:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638412.000630:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183600256 00000100:00100000:0.0:1788638412.000639:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183600256 00000100:00100000:0.0:1788638412.000695:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183600128 00000100:00100000:0.0:1788638412.000698:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183600128 00000100:00100000:0.0:1788638412.000726:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788638412.000734:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875523183600256:12345-0@lo:400: 00000100:00100000:0.0:1788638412.000811:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4659180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875523183600256:12345-0@lo:400: Request processed in 77us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638412.001011:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b465b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3292:1875523183600000:0@lo:400: 00000100:00100000:2.0:1788638412.001049:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638412.001072:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1875523183600512:0@lo:400: 00000100:00100000:2.0:1788638412.001113:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638412.001129:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788638412.001134:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183600384:0@lo:400: 00000100:00100000:2.0:1788638412.001157:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638412.001202:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183600640 00000100:00100000:2.0:1788638412.001206:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183600640 00000100:00100000:2.0:1788638412.001246:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183600384 00000100:00100000:2.0:1788638412.001249:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183600384 00000100:00100000:2.0:1788638412.001264:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788638412.001271:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b465bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183600640:12345-0@lo:400: 00000100:00100000:2.0:1788638412.001303:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b465bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183600640:12345-0@lo:400: Request processed in 33us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638412.001310:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788638412.001325:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788638412.001331:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183600384:12345-0@lo:400: 00000100:00100000:2.0:1788638412.001372:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183600384:12345-0@lo:400: Request processed in 42us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638412.001377:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:2.0:1788638412.001397:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788638412.001401:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788638412.001404:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788638412.001438:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b4659c00 x1875523183600384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638412.001453:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183600384:0@lo:400: 00000100:00100000:2.0:1788638412.001476:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183600512 00000100:00100000:2.0:1788638412.001479:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183600512 00000100:00100000:2.0:1788638412.001505:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788638412.001512:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b465b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183600128:12345-0@lo:400: 00000100:00100000:2.0:1788638412.001542:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b465b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183600128:12345-0@lo:400: Request processed in 31us (995us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638412.001550:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788638412.001561:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788638412.001567:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875523183600512:12345-0@lo:400: 00000100:00100000:2.0:1788638412.001596:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f26300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875523183600512:12345-0@lo:400: Request processed in 30us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638412.001602:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1788638412.001614:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638412.001632:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1875523183600512:0@lo:400: 00000100:00100000:2.0:1788638412.001663:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b465aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183600128:0@lo:400: 00010000:00080000:2.0:1788638412.001674:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b4658e00 x1875523183600640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638428 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638412.001683:0:3294:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788638412.001693:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183600640:0@lo:400: 00000100:00100000:2.0:1788638412.001705:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4658700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3294:1875523183600256:0@lo:400: 00000100:00100000:3.0:1788638412.001823:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183600000 00000100:00100000:3.0:1788638412.001827:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183600000 00000100:00100000:3.0:1788638412.001859:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788638412.001866:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3292:x1875523183600000:12345-0@lo:400: 00000100:00100000:3.0:1788638412.001905:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3292:x1875523183600000:12345-0@lo:400: Request processed in 39us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638412.001911:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788638412.001957:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b465b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3292:1875523183600000:0@lo:400: 00000100:00100000:0.0:1788638412.002373:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788638412.512002:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788638412.512027:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183600768:0@lo:13: 00000100:00100000:3.0:1788638412.512111:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638412.512246:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183600768 00000100:00100000:0.0:1788638412.512255:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183600768 00000100:00100000:0.0:1788638412.512315:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788638412.512325:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183600768:12345-0@lo:13: 00002000:00000024:0.0:1788638412.512351:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638412.512401:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183600768:12345-0@lo:13: Request processed in 77us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638412.512408:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788638412.512542:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b4659500 x1875523183600768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638428 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638412.512569:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4659500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183600768:0@lo:13: 00010000:00010000:2.0:1788638412.704011:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788638413.592130:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 00196f64-ae55-4ffc-b84c-468028ab3a77 00010000:00010000:1.0:1788638413.728517:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638414.100175:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638414.100235:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638414.100269:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638414.100294:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638414.100345:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174141440 00000100:00100000:0.0:1788638414.100357:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174141440 00000100:00100000:0.0:1788638414.100441:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 25 00000100:00100000:0.0:1788638414.100453:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2365:x1875523174141440:12345-192.168.203.34@tcp:400: 00000100:00100000:0.0:1788638414.100543:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4659500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2365:x1875523174141440:12345-192.168.203.34@tcp:400: Request processed in 92us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638414.100551:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 25 00000100:00100000:0.0:1788638414.100579:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174141568 00000100:00100000:0.0:1788638414.100582:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174141568 00000100:00100000:1.0:1788638414.101393:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174141312 00000100:00100000:1.0:1788638414.101408:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174141312 00000100:00100000:1.0:1788638414.101470:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 129 00000100:00100000:1.0:1788638414.101480:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+10:2365:x1875523174141312:12345-192.168.203.34@tcp:400: 00000100:00100000:1.0:1788638414.101555:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+10:2365:x1875523174141312:12345-192.168.203.34@tcp:400: Request processed in 76us (1394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638414.101563:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 129 00000100:00100000:0.0:1788638414.104448:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174141696 00000100:00100000:0.0:1788638414.104466:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174141696 00000100:00100000:0.0:1788638414.104527:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:0.0:1788638414.104539:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b465b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2365:x1875523174141568:12345-192.168.203.34@tcp:400: 00000100:00100000:0.0:1788638414.104637:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b465b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2365:x1875523174141568:12345-192.168.203.34@tcp:400: Request processed in 100us (4366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638414.104646:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:0.0:1788638414.104665:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:0.0:1788638414.104672:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2365:x1875523174141696:12345-192.168.203.34@tcp:400: 00000100:00100000:0.0:1788638414.104694:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2365:x1875523174141696:12345-192.168.203.34@tcp:400: Request processed in 23us (4400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638414.104701:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00080000:0.0:1788638414.104728:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788638414.104732:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788638414.104736:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1788638414.143618:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 00196f64-ae55-4ffc-b84c-468028ab3a77 00010000:00010000:3.0:1788638414.754176:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788638414.935051:0:8304:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788638415.073202:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183600896:0@lo:13: 00000100:00100000:1.0:1788638415.073278:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638415.073385:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183600896 00000100:00100000:0.0:1788638415.073395:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183600896 00000100:00100000:0.0:1788638415.073456:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788638415.073472:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183600896:12345-0@lo:13: 00002000:00000024:0.0:1788638415.073509:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638415.073561:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183600896:12345-0@lo:13: Request processed in 91us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638415.073568:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788638415.073606:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b4658e00 x1875523183600896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638431 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638415.073624:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4658e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183600896:0@lo:13: 00000100:00080000:1.0:1788638415.073897:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788638415.776256:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638416.816683:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638417.120151:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3292:1875523183601024:0@lo:400: 00000100:00100000:0.0:1788638417.120236:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638417.120304:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1875523183601536:0@lo:400: 00000100:00100000:0.0:1788638417.120345:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638417.120384:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183601408:0@lo:400: 00000100:00100000:0.0:1788638417.120416:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183601024 00000100:00100000:2.0:1788638417.120419:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638417.120423:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183601024 00000100:00100000:2.0:1788638417.120450:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183601152:0@lo:400: 00000100:00100000:2.0:1788638417.120474:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638417.120492:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183601664:0@lo:400: 00000100:00100000:0.0:1788638417.120492:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788638417.120501:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3292:x1875523183601024:12345-0@lo:400: 00000100:00100000:2.0:1788638417.120511:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638417.120528:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788638417.120533:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183601280:0@lo:400: 00000100:00100000:0.0:1788638417.120549:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3292:x1875523183601024:12345-0@lo:400: Request processed in 49us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638417.120556:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788638417.120575:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638417.120589:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183601408 00000100:00100000:0.0:1788638417.120592:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183601408 00000100:00100000:2.0:1788638417.120605:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183601536 00000100:00100000:2.0:1788638417.120608:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183601536 00000100:00100000:0.0:1788638417.120625:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183601664 00000100:00100000:0.0:1788638417.120627:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183601664 00000100:00100000:2.0:1788638417.120636:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183601152 00000100:00100000:2.0:1788638417.120638:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183601152 00000100:00100000:0.0:1788638417.120642:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788638417.120648:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183601408:12345-0@lo:400: 00000100:00100000:2.0:1788638417.120649:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183601280 00000100:00100000:2.0:1788638417.120651:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183601280 00000100:00100000:2.0:1788638417.120663:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788638417.120669:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875523183601536:12345-0@lo:400: 00000100:00100000:2.0:1788638417.120701:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4658e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875523183601536:12345-0@lo:400: Request processed in 32us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638417.120708:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788638417.120723:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788638417.120730:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183601152:12345-0@lo:400: 00000100:00100000:2.0:1788638417.121388:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f26a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183601152:12345-0@lo:400: Request processed in 656us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638417.121397:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788638417.121414:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788638417.121423:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183601280:12345-0@lo:400: 00000100:00100000:2.0:1788638417.121457:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f25c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183601280:12345-0@lo:400: Request processed in 37us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638417.121462:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788638417.121511:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183601280:0@lo:400: 00000100:00100000:2.0:1788638417.121522:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183601152:0@lo:400: 00000100:00100000:0.0:1788638417.122824:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183601408:12345-0@lo:400: Request processed in 2170us (2398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638417.122848:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788638417.122876:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788638417.122886:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183601664:12345-0@lo:400: 00000100:00100000:0.0:1788638417.122920:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f24700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183601664:12345-0@lo:400: Request processed in 38us (2407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638417.122926:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1788638417.122957:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788638417.122963:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788638417.122966:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788638417.123000:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1875523183601536:0@lo:400: 00000100:00100000:0.0:1788638417.123012:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3292:1875523183601024:0@lo:400: 00010000:00080000:3.0:1788638417.123110:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73ad39d500 x1875523183601408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638417.123123:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183601408:0@lo:400: 00010000:00080000:2.0:1788638417.125301:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73ad39f480 x1875523183601664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638433 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638417.125319:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183601664:0@lo:400: 00000100:00100000:2.0:1788638417.631924:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788638417.631952:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183601792:0@lo:13: 00000100:00100000:2.0:1788638417.632038:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638417.632109:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183601792 00000100:00100000:2.0:1788638417.632116:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183601792 00000100:00100000:2.0:1788638417.632189:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788638417.632200:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183601792:12345-0@lo:13: 00002000:00000024:2.0:1788638417.632241:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788638417.632295:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f24e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183601792:12345-0@lo:13: Request processed in 97us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638417.632302:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788638417.632356:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b4f25f80 x1875523183601792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638433 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638417.632397:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183601792:0@lo:13: 00010000:00010000:3.0:1788638417.824017:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788638418.753576:0:8451:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffefc671f00 20000000:00000080:0.0:1788638418.753594:0:8451:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c73ad048000 uarg=0000000000000000 20000000:01000000:0.0:1788638418.753633:0:8451:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788638418.753636:0:8451:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788638418.753638:0:8451:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788638418.753643:0:8451:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788638418.753649:0:8451:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788638418.753663:0:8451:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788638418.753666:0:8451:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788638418.760225:0:8451:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788638418.760233:0:8451:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788638418.767399:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1788638418.771670:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1788638418.771750:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788638418.772095:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1788638418.772119:0:8451:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788638418.772122:0:8451:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788638418.776559:0:8453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788638418.777433:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788638418.777507:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788638418.777555:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1788638418.777570:0:8451:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788638418.777572:0:8451:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788638418.786676:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:2.0:1788638418.791597:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:2.0:1788638418.791688:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:2.0:1788638418.791728:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:2.0:1788638418.791746:0:8451:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788638418.791749:0:8451:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788638418.794285:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1788638418.794813:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1788638418.794883:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1788638418.794939:0:8451:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 10000000:01000000:2.0:1788638418.794970:0:8451:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788638418.795002:0:8451:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7399aa6200/0xa0b1f1e3b4b2a7f7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.795022:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7380030400/0xa0b1f1e3b4b2a6f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a6ed expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.795030:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7399aa7800/0xa0b1f1e3b4b2a71e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a717 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.795036:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a748 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a741 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.795042:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2a756 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a74f expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.795049:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a764 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a75d expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.795068:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7380030c00/0xa0b1f1e3b4b2a780 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a779 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.795075:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a7aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a7a3 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.795084:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a7b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cbe expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.795091:0:8451:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a7bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cc5 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.795099:0:8451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7399aa6200/0xa0b1f1e3b4b2a7f7 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.795139:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a7bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cc5 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.795154:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a7bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cc5 expref: 9 pid: 5834 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638418.795180:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f25f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1875523183601920:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638418.795289:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a7b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cbe expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.795298:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a7b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cbe expref: 9 pid: 5834 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638418.795308:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f25880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1875523183602048:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638418.795352:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a7aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a7a3 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.795361:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a7aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a7a3 expref: 18 pid: 5837 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638418.795370:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f26d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1875523183602176:0@lo:104: 00000100:00100000:2.0:1788638418.795409:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788638418.795443:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7380030c00/0xa0b1f1e3b4b2a780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a779 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.795452:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7380030c00/0xa0b1f1e3b4b2a780 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a779 expref: 18 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638418.795460:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f27100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1875523183602304:0@lo:104: 00000100:00100000:2.0:1788638418.795482:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638418.795519:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788638418.795532:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183602176 00000100:00100000:2.0:1788638418.795538:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183602176 00000100:00100000:2.0:1788638418.795571:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183602304 00000100:00100000:2.0:1788638418.795575:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183602304 00000100:00100000:2.0:1788638418.795590:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788638418.795599:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+4:8451:x1875523183602176:12345-0@lo:104: 00010000:00010000:2.0:1788638418.795612:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a7a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a7aa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.795656:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788638418.795662:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f25500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+4:8451:x1875523183602176:12345-0@lo:104: Request processed in 65us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638418.795679:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788638418.795695:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788638418.795701:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7e31850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:8451:x1875523183602304:12345-0@lo:104: 00010000:00010000:2.0:1788638418.795708:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a780 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.795748:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788638418.795753:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7e31850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:8451:x1875523183602304:12345-0@lo:104: Request processed in 53us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638418.795759:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:2.0:1788638418.795826:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a764 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a75d expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.795835:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a764 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a75d expref: 18 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638418.796416:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f25500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1875523183602432:0@lo:104: 00000100:00100000:2.0:1788638418.796444:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788638418.796478:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2a756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a74f expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.796487:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2a756 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a74f expref: 18 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638418.796495:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f27b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1875523183602560:0@lo:104: 00000100:00100000:2.0:1788638418.796515:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788638418.796535:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a741 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.796556:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a748 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a741 expref: 18 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638418.796564:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f25180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1875523183602688:0@lo:104: 00000100:00100000:2.0:1788638418.796588:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788638418.796602:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7399aa7800/0xa0b1f1e3b4b2a71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a717 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.796609:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7399aa7800/0xa0b1f1e3b4b2a71e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a717 expref: 18 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638418.796615:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f24a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1875523183602816:0@lo:104: 00000100:00100000:2.0:1788638418.796646:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788638418.796666:0:8451:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7380030400/0xa0b1f1e3b4b2a6f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a6ed expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.796673:0:8451:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7380030400/0xa0b1f1e3b4b2a6f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a6ed expref: 18 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638418.796680:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1875523183602944:0@lo:104: 00000100:00100000:2.0:1788638418.796700:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638418.796710:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c35cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638418.796730:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f26d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1875523183602176:0@lo:104: 00000100:00100000:2.0:1788638418.796740:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f27100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1875523183602304:0@lo:104: 00010000:00010000:2.0:1788638418.796774:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788638418.796800:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a7a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a7aa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.796819:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6a00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:2.0:1788638418.796823:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a7a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a7aa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.796832:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a7aa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.797058:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638418.797065:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a780 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.797072:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031200 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:1.0:1788638418.797076:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a779 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a780 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.797093:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a780 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638418.797100:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a780 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638418.797105:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788638418.797139:0:7639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a779 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a780 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.797145:0:7639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788638418.797179:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a779 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a780 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.797187:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2a779 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a780 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.797211:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638418.797212:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638418.797214:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638418.797234:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788638418.797245:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3292:1875523183603072:0@lo:103: 00000100:00100000:1.0:1788638418.797278:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638418.797310:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183603072 00000100:00100000:1.0:1788638418.797328:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183603072 00010000:00010000:1.0:1788638418.797356:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7380030c00/0xa0b1f1e3b4b2a780 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a779 expref: 19 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638418.797387:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788638418.797395:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3292:x1875523183603072:12345-0@lo:103: 00010000:00010000:1.0:1788638418.797414:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638418.797420:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7380030c00/0xa0b1f1e3b4b2a780 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a779 expref: 19 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.797429:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7380030c00/0xa0b1f1e3b4b2a780 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a779 expref: 19 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.797443:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7380030c00/0xa0b1f1e3b4b2a780 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a779 expref: 19 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.797456:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638418.797487:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:3292:x1875523183603072:12345-0@lo:103: Request processed in 94us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638418.797494:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788638418.797527:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3292:1875523183603072:0@lo:103: 00000100:00100000:0.0:1788638418.797985:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183602432 00000100:00100000:0.0:1788638418.797991:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183602432 00000100:00100000:0.0:1788638418.798014:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183602560 00000100:00100000:0.0:1788638418.798016:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183602560 00000100:00100000:0.0:1788638418.798025:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183602688 00000100:00100000:0.0:1788638418.798034:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183602688 00000100:00100000:0.0:1788638418.798048:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183602816 00000100:00100000:0.0:1788638418.798051:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183602816 00000100:00100000:0.0:1788638418.798060:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183602944 00000100:00100000:0.0:1788638418.798062:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183602944 00000100:00100000:0.0:1788638418.798072:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788638418.798078:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+7:8451:x1875523183602432:12345-0@lo:104: 00010000:00010000:0.0:1788638418.798088:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2a75d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a764 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638418.798153:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788638418.798159:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f27480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+7:8451:x1875523183602432:12345-0@lo:104: Request processed in 82us (1714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638418.798175:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788638418.798189:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788638418.798195:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+6:8451:x1875523183602560:12345-0@lo:104: 00010000:00010000:0.0:1788638418.798202:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a74f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a756 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638418.798231:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788638418.798235:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f24000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+6:8451:x1875523183602560:12345-0@lo:104: Request processed in 41us (1720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638418.798241:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788638418.798252:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788638418.798256:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+5:8451:x1875523183602688:12345-0@lo:104: 00010000:00010000:0.0:1788638418.798263:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c7381684200/0xa0b1f1e3b4b2a741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a748 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638418.798289:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788638418.798299:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f26680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+5:8451:x1875523183602688:12345-0@lo:104: Request processed in 42us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638418.798305:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788638418.798316:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788638418.798322:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+4:8451:x1875523183602816:12345-0@lo:104: 00010000:00010000:0.0:1788638418.798329:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2a717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a71e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638418.798356:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788638418.798360:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+4:8451:x1875523183602816:12345-0@lo:104: Request processed in 40us (1714us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638418.798365:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788638418.798374:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788638418.798379:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:8451:x1875523183602944:12345-0@lo:104: 00010000:00010000:0.0:1788638418.798387:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c73829f1000/0xa0b1f1e3b4b2a6ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a6f4 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638418.798408:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788638418.798412:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:8451:x1875523183602944:12345-0@lo:104: Request processed in 34us (1712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638418.798416:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 10000000:00010000:2.0:1788638418.798933:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a7a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a7aa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638418.798941:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788638418.800390:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788638418.800402:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2a75d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a764 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800412:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7a00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:1.0:1788638418.800416:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2a75d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a764 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800432:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2a75d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a764 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638418.800439:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2a75d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a764 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638418.800446:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788638418.800496:0:7639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2a75d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a764 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800502:0:7639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788638418.800521:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2a75d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a764 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800529:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2a75d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a764 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800546:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788638418.800550:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a74f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a756 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800555:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030e00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:1.0:1788638418.800557:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a74f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a756 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800564:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a74f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a756 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638418.800570:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a74f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a756 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638418.800574:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788638418.800587:0:7639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a74f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a756 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800593:0:7639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788638418.800611:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a74f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a756 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800629:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7380030e00/0xa0b1f1e3b4b2a74f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a756 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800641:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788638418.800645:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7381684200/0xa0b1f1e3b4b2a741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a748 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800650:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7381684200 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:1.0:1788638418.800653:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7381684200/0xa0b1f1e3b4b2a741 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a748 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800659:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7381684200/0xa0b1f1e3b4b2a741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a748 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638418.800666:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7381684200/0xa0b1f1e3b4b2a741 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a748 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638418.800671:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788638418.800684:0:7639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7381684200/0xa0b1f1e3b4b2a741 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a748 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800689:0:7639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788638418.800694:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7381684200/0xa0b1f1e3b4b2a741 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a748 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800699:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7381684200/0xa0b1f1e3b4b2a741 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a748 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800709:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788638418.800718:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2a717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a71e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800723:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031400 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:1.0:1788638418.800726:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2a717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a71e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800733:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2a717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a71e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638418.800739:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2a717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a71e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638418.800744:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788638418.800771:0:7639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2a717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a71e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800776:0:7639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788638418.800797:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2a717 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a71e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800804:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2a717 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a71e expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800813:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638418.800816:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c73829f1000/0xa0b1f1e3b4b2a6ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a6f4 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800821:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73829f1000 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:1.0:1788638418.800824:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c73829f1000/0xa0b1f1e3b4b2a6ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a6f4 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800854:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c73829f1000/0xa0b1f1e3b4b2a6ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a6f4 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638418.800860:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c73829f1000/0xa0b1f1e3b4b2a6ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a6f4 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638418.800865:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788638418.800880:0:7639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c73829f1000/0xa0b1f1e3b4b2a6ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a6f4 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800885:0:7639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788638418.800889:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c73829f1000/0xa0b1f1e3b4b2a6ed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a6f4 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800896:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c73829f1000/0xa0b1f1e3b4b2a6ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a6f4 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.800906:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638418.800907:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638418.800909:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638418.800925:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3292:1875523183603200:0@lo:103: 00010000:00010000:2.0:1788638418.801216:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a7a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a7aa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.801224:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788638418.801228:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a7a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a7aa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.801233:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a7a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a7aa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.801258:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638418.801260:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638418.801261:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638418.801272:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183603328:0@lo:103: 00010000:00010000:2.0:1788638418.801636:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638418.801647:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183603584:0@lo:103: 00000100:00100000:2.0:1788638418.801682:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183603456:0@lo:103: 00000100:00100000:1.0:1788638418.801752:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638418.801819:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3292:1875523183603712:0@lo:103: 00000100:00100000:1.0:1788638418.801842:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638418.803440:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183603200 00000100:00100000:1.0:1788638418.803451:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183603200 00010000:00010000:1.0:1788638418.803497:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a764 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a75d expref: 18 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638418.803551:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183603712 00000100:00100000:1.0:1788638418.803555:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183603712 00010000:00010000:1.0:1788638418.803569:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7380030400/0xa0b1f1e3b4b2a6f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a6ed expref: 19 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638418.803583:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788638418.803592:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3292:x1875523183603200:12345-0@lo:103: 00010000:00010000:1.0:1788638418.803609:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638418.803616:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a764 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a75d expref: 19 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.803628:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a764 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a75d expref: 19 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.803650:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638418.803715:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3292:x1875523183603200:12345-0@lo:103: Request processed in 123us (2732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638418.803722:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788638418.803737:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788638418.803743:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:3292:x1875523183603712:12345-0@lo:103: 00010000:00010000:1.0:1788638418.803751:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638418.803756:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7380030400/0xa0b1f1e3b4b2a6f4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a6ed expref: 18 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.803764:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7380030400/0xa0b1f1e3b4b2a6f4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a6ed expref: 18 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.803775:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638418.803824:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:3292:x1875523183603712:12345-0@lo:103: Request processed in 81us (1981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638418.803831:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788638418.803867:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3292:1875523183603200:0@lo:103: 00000100:00100000:1.0:1788638418.803877:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3292:1875523183603712:0@lo:103: 00010000:00010000:1.0:1788638418.803922:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a764 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a75d expref: 17 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638418.803937:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f25500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1875523183602432:0@lo:104: 00000100:00100000:1.0:1788638418.803947:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f27b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1875523183602560:0@lo:104: 00000100:00100000:1.0:1788638418.803955:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f25180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1875523183602688:0@lo:104: 00000100:00100000:1.0:1788638418.803964:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f24a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1875523183602816:0@lo:104: 00010000:00010000:1.0:1788638418.803973:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7380030400/0xa0b1f1e3b4b2a6f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a6ed expref: 16 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638418.804110:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638418.804152:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638418.804191:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638418.804209:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183603840:0@lo:103: 00000100:00100000:2.0:1788638418.804242:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638418.804267:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183603456 00000100:00100000:2.0:1788638418.804272:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183603456 00010000:00010000:2.0:1788638418.804289:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a748 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a741 expref: 16 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638418.804303:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183603584 00000100:00100000:2.0:1788638418.804306:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183603584 00010000:00010000:2.0:1788638418.804316:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7399aa7800/0xa0b1f1e3b4b2a71e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a717 expref: 17 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638418.804325:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183603328 00000100:00100000:2.0:1788638418.804328:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183603328 00010000:00010000:2.0:1788638418.804342:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2a756 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a74f expref: 18 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638418.804350:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183603840 00000100:00100000:2.0:1788638418.804353:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183603840 00010000:00010000:2.0:1788638418.804364:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a7aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a7a3 expref: 19 pid: 5837 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638418.804374:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788638418.804380:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183603456:12345-0@lo:103: 00010000:00010000:2.0:1788638418.804388:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638418.804392:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a748 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a741 expref: 19 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.804414:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a748 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a741 expref: 19 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.804425:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a748 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a741 expref: 19 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.804436:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638418.804464:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:3294:x1875523183603456:12345-0@lo:103: Request processed in 83us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638418.804470:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788638418.804484:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788638418.804490:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:3291:x1875523183603584:12345-0@lo:103: 00010000:00010000:2.0:1788638418.804497:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638418.804501:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7399aa7800/0xa0b1f1e3b4b2a71e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a717 expref: 17 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.804508:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7399aa7800/0xa0b1f1e3b4b2a71e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a717 expref: 17 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.804518:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7399aa7800/0xa0b1f1e3b4b2a71e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a717 expref: 17 pid: 5835 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.804526:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638418.804551:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:3291:x1875523183603584:12345-0@lo:103: Request processed in 62us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638418.804556:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788638418.804568:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788638418.804574:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:3293:x1875523183603328:12345-0@lo:103: 00010000:00010000:2.0:1788638418.804587:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638418.804592:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2a756 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a74f expref: 15 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.804600:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2a756 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a74f expref: 15 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.804610:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2a756 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a74f expref: 15 pid: 5834 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.804621:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638418.804647:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:3293:x1875523183603328:12345-0@lo:103: Request processed in 73us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638418.804653:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788638418.804665:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788638418.804670:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:3293:x1875523183603840:12345-0@lo:103: 00010000:00010000:2.0:1788638418.804678:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638418.804681:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a7aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a7a3 expref: 13 pid: 5837 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.804689:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a7aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a7a3 expref: 13 pid: 5837 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.804699:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a7aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a7a3 expref: 13 pid: 5837 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638418.804707:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638418.804726:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dff050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:3293:x1875523183603840:12345-0@lo:103: Request processed in 57us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638418.804731:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788638418.804804:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183603456:0@lo:103: 00000100:00100000:2.0:1788638418.804827:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183603584:0@lo:103: 00000100:00100000:2.0:1788638418.804845:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183603328:0@lo:103: 00000100:00100000:2.0:1788638418.804852:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183603840:0@lo:103: 00000100:00100000:1.0:1788638418.805698:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1875523183602944:0@lo:104: 00000100:00100000:0.0:1788638418.806537:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638418.806573:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638418.806603:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174141952 00000100:00100000:0.0:1788638418.806611:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174141952 00010000:00010000:0.0:1788638418.806645:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a7b8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cbe expref: 10 pid: 5834 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638418.806673:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174141824 00000100:00100000:0.0:1788638418.806688:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174141824 00010000:00010000:0.0:1788638418.806701:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a7bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cc5 expref: 11 pid: 5834 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638418.806716:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 19 00000100:00100000:0.0:1788638418.806725:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b465aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55273f9a-386c-4321-9748-c194b047efe8+11:2364:x1875523174141952:12345-192.168.203.34@tcp:103: 00010000:00010000:0.0:1788638418.806740:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638418.806746:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a7b8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cbe expref: 11 pid: 5834 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638418.806756:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a7b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cbe expref: 11 pid: 5834 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638418.806772:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638418.806855:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b465aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55273f9a-386c-4321-9748-c194b047efe8+11:2364:x1875523174141952:12345-192.168.203.34@tcp:103: Request processed in 130us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638418.806862:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 19 00000100:00100000:0.0:1788638418.806878:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 20 00000100:00100000:0.0:1788638418.806883:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55273f9a-386c-4321-9748-c194b047efe8+10:2364:x1875523174141824:12345-192.168.203.34@tcp:103: 00010000:00010000:0.0:1788638418.806890:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638418.806894:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a7bf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cc5 expref: 10 pid: 5834 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638418.806903:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a7bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cc5 expref: 10 pid: 5834 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638418.806914:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7399aa6200/0xa0b1f1e3b4b2a7f7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638418.806932:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7399aa6200/0xa0b1f1e3b4b2a7f7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638418.806946:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7399aa6200/0xa0b1f1e3b4b2a7f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638418.806953:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7399aa6200/0xa0b1f1e3b4b2a7f7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638418.806960:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7399aa6200/0xa0b1f1e3b4b2a7f7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638418.806967:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7399aa6200/0xa0b1f1e3b4b2a7f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638418.806973:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6200 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638418.806977:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7399aa6200/0xa0b1f1e3b4b2a7f7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638418.807134:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7399aa6200/0xa0b1f1e3b4b2a7f7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638418.807144:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7399aa6200/0xa0b1f1e3b4b2a7f7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638418.807157:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638418.807191:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4659f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55273f9a-386c-4321-9748-c194b047efe8+10:2364:x1875523174141824:12345-192.168.203.34@tcp:103: Request processed in 306us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638418.807198:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 20 00010000:00010000:1.0:1788638418.807825:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a7bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cc5 expref: 9 pid: 5834 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638418.807848:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f25f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1875523183601920:192.168.203.34@tcp:104: 00010000:00010000:1.0:1788638418.807861:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a7b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cbe expref: 8 pid: 5834 timeout: 281 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638418.807871:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f25880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8451:1875523183602048:192.168.203.34@tcp:104: 00010000:00010000:1.0:1788638418.807927:0:8451:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7399aa6200/0xa0b1f1e3b4b2a7f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.807949:0:8451:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7399aa6200/0xa0b1f1e3b4b2a7f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.807955:0:8451:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7399aa6200/0xa0b1f1e3b4b2a7f7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.807961:0:8451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7399aa6200/0xa0b1f1e3b4b2a7f7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8451 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638418.849147:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638419.205665:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638419.205707:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638419.205755:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638419.205824:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638419.206008:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174142464 00000100:00100000:0.0:1788638419.206029:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174142464 00000100:00100000:0.0:1788638419.206127:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174142336 00000100:00100000:0.0:1788638419.206135:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174142336 00000100:00100000:0.0:1788638419.206174:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:0.0:1788638419.206184:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2364:x1875523174142464:12345-192.168.203.34@tcp:400: 00000100:00100000:0.0:1788638419.206254:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2364:x1875523174142464:12345-192.168.203.34@tcp:400: Request processed in 72us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638419.206262:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:0.0:1788638419.206280:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 14 00000100:00100000:0.0:1788638419.206286:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2365:x1875523174142336:12345-192.168.203.34@tcp:400: 00000100:00100000:0.0:1788638419.206310:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2365:x1875523174142336:12345-192.168.203.34@tcp:400: Request processed in 24us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638419.206316:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 14 00000100:00080000:1.0:1788638419.206545:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788638419.206549:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788638419.206927:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174142208 00000100:00100000:2.0:1788638419.206933:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174142208 00000100:00100000:2.0:1788638419.206999:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 29 00000100:00100000:2.0:1788638419.207007:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174142208:12345-192.168.203.34@tcp:400: 00000100:00100000:2.0:1788638419.207064:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174142208:12345-192.168.203.34@tcp:400: Request processed in 58us (1409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638419.207071:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 29 00000100:00080000:1.0:1788638419.207237:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638419.209952:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174142080 00000100:00100000:3.0:1788638419.209966:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174142080 00000100:00100000:3.0:1788638419.210036:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 131 00000100:00100000:3.0:1788638419.210047:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+8:2365:x1875523174142080:12345-192.168.203.34@tcp:400: 00000100:00100000:3.0:1788638419.210131:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+8:2365:x1875523174142080:12345-192.168.203.34@tcp:400: Request processed in 85us (4374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638419.210138:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 131 00000100:00100000:0.0:1788638419.526694:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638419.527346:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174142592 00000100:00100000:1.0:1788638419.527366:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174142592 00000100:00100000:1.0:1788638419.527429:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 132 00000100:00100000:1.0:1788638419.527440:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+8:5608:x1875523174142592:12345-192.168.203.34@tcp:101: 00010000:00010000:1.0:1788638419.527455:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638419.527474:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7381684200/0xa0b1f1e3b4b2a7fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434d27 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638419.527500:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7381684200/0xa0b1f1e3b4b2a7fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d27 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638419.527511:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7381684200/0xa0b1f1e3b4b2a7fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d27 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638419.527543:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7381684200, rc 0) 00000100:00100000:1.0:1788638419.527604:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+9:5608:x1875523174142592:12345-192.168.203.34@tcp:101: Request processed in 166us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638419.527612:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 132 00000100:00100000:1.0:1788638419.533855:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638419.534297:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174142720 00000100:00100000:0.0:1788638419.534307:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174142720 00000100:00100000:0.0:1788638419.534367:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 133 00000100:00100000:0.0:1788638419.534377:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+9:5608:x1875523174142720:12345-192.168.203.34@tcp:501: 00000100:00100000:0.0:1788638419.535180:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+9:5608:x1875523174142720:12345-192.168.203.34@tcp:501: Request processed in 800us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638419.535192:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 133 00000100:00100000:3.0:1788638419.547033:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638419.547246:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174142848 00000100:00100000:1.0:1788638419.547257:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174142848 00000100:00100000:1.0:1788638419.547320:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 134 00000100:00100000:1.0:1788638419.547330:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+9:5608:x1875523174142848:12345-192.168.203.34@tcp:503: 00000100:00100000:1.0:1788638419.547595:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+9:5608:x1875523174142848:12345-192.168.203.34@tcp:503: Request processed in 264us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638419.547604:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 134 00000100:00100000:2.0:1788638419.556487:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638419.557407:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174142976 00000100:00100000:0.0:1788638419.557424:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174142976 00000100:00100000:0.0:1788638419.557478:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 135 00000100:00100000:0.0:1788638419.557488:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+9:6075:x1875523174142976:12345-192.168.203.34@tcp:502: 00000100:00100000:0.0:1788638419.558716:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+9:6075:x1875523174142976:12345-192.168.203.34@tcp:502: Request processed in 1223us (2231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638419.558747:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 135 00000100:00100000:3.0:1788638419.576146:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638419.576284:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174143104 00000100:00100000:2.0:1788638419.576293:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174143104 00000100:00100000:2.0:1788638419.576361:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 136 00000100:00100000:2.0:1788638419.576371:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+9:6075:x1875523174143104:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788638419.576662:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+9:6075:x1875523174143104:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 292us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638419.576670:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 136 00000100:00100000:3.0:1788638419.583289:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638419.591082:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174143232 00000100:00100000:1.0:1788638419.591097:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174143232 00000100:00100000:1.0:1788638419.591253:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 137 00000100:00100000:1.0:1788638419.591265:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+9:5608:x1875523174143232:12345-192.168.203.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788638419.591284:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638419.591308:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a805 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434d2e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638419.591940:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d2e expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638419.591952:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a805 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d2e expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638419.592053:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7381684a00, rc 0) 00000100:00100000:1.0:1788638419.592251:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+10:5608:x1875523174143232:12345-192.168.203.34@tcp:101:ll_cfg_requeue.0 Request processed in 987us (8969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638419.592259:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 137 00000100:00100000:3.0:1788638419.596241:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638419.596622:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174143360 00000100:00100000:0.0:1788638419.596632:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174143360 00000100:00100000:0.0:1788638419.596691:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 138 00000100:00100000:0.0:1788638419.596702:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+10:5608:x1875523174143360:12345-192.168.203.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638419.597630:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+10:5608:x1875523174143360:12345-192.168.203.34@tcp:501:ll_cfg_requeue.0 Request processed in 924us (1391us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788638419.597642:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 138 00010000:00010000:2.0:1788638419.872127:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638420.194055:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183603968:0@lo:13: 00000100:00100000:2.0:1788638420.195056:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638420.195340:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183603968 00000100:00100000:2.0:1788638420.195348:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183603968 00000100:00100000:2.0:1788638420.195411:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788638420.195420:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183603968:12345-0@lo:13: 00002000:00000024:2.0:1788638420.195469:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788638420.195515:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183603968:12345-0@lo:13: Request processed in 96us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638420.195522:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788638420.195541:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788638420.195574:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73bf61ed80 x1875523183603968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638436 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638420.199197:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183603968:0@lo:13: 10000000:01000000:1.0:1788638420.643469:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788638420.643478:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c73b4c0d800 from 39 10000000:01000000:1.0:1788638420.643484:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788638420.643528:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7381685a00/0xa0b1f1e3b4b2a80c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638420.643550:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7381685a00/0xa0b1f1e3b4b2a80c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638420.643561:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7381685a00/0xa0b1f1e3b4b2a80c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638420.643584:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183604096:0@lo:101: 00000100:00100000:1.0:1788638420.643671:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638420.643726:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b46406c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638420.643814:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183604096 00000100:00100000:3.0:1788638420.643822:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183604096 00000100:00100000:3.0:1788638420.643877:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788638420.643886:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+12:5840:x1875523183604096:12345-0@lo:101: 00010000:00010000:3.0:1788638420.643898:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638420.643913:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73829f1e00/0xa0b1f1e3b4b2a813 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a80c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638420.643936:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73829f1e00/0xa0b1f1e3b4b2a813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a80c expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638420.643947:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73829f1e00/0xa0b1f1e3b4b2a813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a80c expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638420.643957:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73829f1e00, rc 0) 00000100:00100000:3.0:1788638420.644016:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:5840:x1875523183604096:12345-0@lo:101: Request processed in 130us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638420.644023:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788638420.644572:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183604096:0@lo:101: 00010000:00010000:1.0:1788638420.644591:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7381685a00/0xa0b1f1e3b4b2a80c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a813 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638420.644600:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7381685a00/0xa0b1f1e3b4b2a80c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a813 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638420.644656:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183604224:0@lo:501: 00000100:00100000:1.0:1788638420.644698:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638420.644731:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b46406c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638420.644861:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183604224 00000100:00100000:2.0:1788638420.644878:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183604224 00000100:00100000:2.0:1788638420.644915:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788638420.644923:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:5840:x1875523183604224:12345-0@lo:501: 00000100:00100000:2.0:1788638420.645182:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:5840:x1875523183604224:12345-0@lo:501: Request processed in 260us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638420.645190:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788638420.645326:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183604224:0@lo:501: 00000100:00100000:1.0:1788638420.645430:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183604352:0@lo:503: 00000100:00100000:1.0:1788638420.645472:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638420.645490:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b46406c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638420.645648:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183604352 00000100:00100000:2.0:1788638420.645652:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183604352 00000100:00100000:2.0:1788638420.645722:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788638420.645730:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:5840:x1875523183604352:12345-0@lo:503: 00000100:00100000:2.0:1788638420.645910:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:5840:x1875523183604352:12345-0@lo:503: Request processed in 179us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638420.645916:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788638420.649699:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183604352:0@lo:503: 00000100:00100000:3.0:1788638420.655234:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8476:1875523183604480:0@lo:502: 00000100:00100000:3.0:1788638420.655318:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638420.655376:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738a4bba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788638420.655597:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183604480 00000100:00100000:1.0:1788638420.655606:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183604480 00000100:00100000:1.0:1788638420.655657:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788638420.655667:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:8476:x1875523183604480:12345-0@lo:502: 00000100:00100000:1.0:1788638420.655946:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:8476:x1875523183604480:12345-0@lo:502: Request processed in 281us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638420.655955:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788638420.656184:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8476:1875523183604480:0@lo:502: 00000100:00100000:2.0:1788638420.656235:0:8476:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8476:1875523183604608:0@lo:502: 00000100:00100000:2.0:1788638420.656281:0:8476:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638420.656315:0:8476:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c350c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638420.656561:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183604608 00000100:00100000:3.0:1788638420.656567:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183604608 00000100:00100000:3.0:1788638420.656602:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788638420.656609:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:8476:x1875523183604608:12345-0@lo:502: 00000100:00100000:3.0:1788638420.656757:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:8476:x1875523183604608:12345-0@lo:502: Request processed in 147us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638420.656764:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788638420.656998:0:8476:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8476:1875523183604608:0@lo:502: 00000040:00080000:2.0:1788638420.657024:0:8476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788638420.658990:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788638420.659018:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788638420.659028:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7381685a00/0xa0b1f1e3b4b2a80c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a813 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638420.659040:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7381685a00/0xa0b1f1e3b4b2a80c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a813 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638420.659051:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788638420.659054:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788638420.659057:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788638420.659091:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a81a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638420.659100:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a81a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638420.659133:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a81a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638420.659163:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183604736:0@lo:101: 00000100:00100000:3.0:1788638420.659225:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638420.659269:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738a4bb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638420.659556:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183604736 00000100:00100000:1.0:1788638420.659563:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183604736 00000100:00100000:1.0:1788638420.659613:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788638420.659623:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+13:5840:x1875523183604736:12345-0@lo:101: 00010000:00010000:1.0:1788638420.659636:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638420.659649:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7381685e00/0xa0b1f1e3b4b2a821 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a81a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638420.659671:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7381685e00/0xa0b1f1e3b4b2a821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a81a expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638420.659682:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7381685e00/0xa0b1f1e3b4b2a821 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a81a expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638420.659701:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7381685e00, rc 0) 00000100:00100000:1.0:1788638420.659742:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:5840:x1875523183604736:12345-0@lo:101: Request processed in 121us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638420.659749:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788638420.660581:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183604736:0@lo:101: 00010000:00010000:3.0:1788638420.660602:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a81a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a821 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638420.660611:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a81a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a821 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638420.660673:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183604864:0@lo:501: 00000100:00100000:3.0:1788638420.660713:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638420.660752:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738a4bb6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638420.660920:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183604864 00000100:00100000:1.0:1788638420.660926:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183604864 00000100:00100000:1.0:1788638420.660957:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788638420.660964:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:5840:x1875523183604864:12345-0@lo:501: 00000100:00100000:1.0:1788638420.661247:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:5840:x1875523183604864:12345-0@lo:501: Request processed in 282us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638420.661255:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788638420.661385:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183604864:0@lo:501: 00000100:00100000:2.0:1788638420.661432:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183604992:0@lo:503: 00000100:00100000:2.0:1788638420.661474:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638420.661505:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c350c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638420.661684:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183604992 00000100:00100000:1.0:1788638420.661689:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183604992 00000100:00100000:1.0:1788638420.661723:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788638420.661730:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:5840:x1875523183604992:12345-0@lo:503: 00000100:00100000:1.0:1788638420.661909:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:5840:x1875523183604992:12345-0@lo:503: Request processed in 179us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638420.661916:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788638420.661968:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183604992:0@lo:503: 00000100:00100000:1.0:1788638420.662214:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8477:1875523183605120:0@lo:502: 00000100:00100000:1.0:1788638420.662249:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638420.662269:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183605120 00000100:00100000:1.0:1788638420.662273:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183605120 00000100:00100000:1.0:1788638420.662289:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788638420.662296:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:8477:x1875523183605120:12345-0@lo:502: 00000100:00100000:2.0:1788638420.663858:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b4640780 going to sleep for 11 seconds 00000100:00100000:1.0:1788638420.664358:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:8477:x1875523183605120:12345-0@lo:502: Request processed in 2048us (2095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638420.664370:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788638420.675676:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8477:1875523183605120:0@lo:502: 00000020:01000000:3.0:1788638420.676675:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788638420.676693:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638420.676696:0:8477:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788638420.676704:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788638420.676749:0:8477:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8477:1875523183605248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788638420.676867:0:8477:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638420.676908:0:8477:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738a4bb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638420.680009:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183605248 00000100:00100000:0.0:1788638420.680021:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183605248 00000100:00100000:0.0:1788638420.680088:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788638420.680100:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:8477:x1875523183605248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638420.680461:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:8477:x1875523183605248:12345-0@lo:502:llog_process_th.0 Request processed in 362us (3592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638420.680470:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788638420.680511:0:8477:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8477:1875523183605248:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788638420.680542:0:8477:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638420.680548:0:8477:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638420.680553:0:8477:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788638420.680558:0:8477:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788638420.682523:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788638420.682557:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788638420.682570:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a81a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a821 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638420.682583:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a81a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a821 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638420.682595:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788638420.682598:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c73bce5d800 from 39 10000000:01000000:2.0:1788638420.682601:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788638420.682637:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2a828 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638420.682645:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2a828 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638420.682655:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2a828 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638420.682689:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183605376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788638420.682747:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638420.682801:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c35f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788638420.683533:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183605376 00000100:00100000:1.0:1788638420.683541:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183605376 00000100:00100000:1.0:1788638420.684041:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788638420.684053:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:5840:x1875523183605376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788638420.684067:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638420.684097:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7385308e00/0xa0b1f1e3b4b2a82f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a828 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638420.684244:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7385308e00/0xa0b1f1e3b4b2a82f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a828 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638420.684256:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7385308e00/0xa0b1f1e3b4b2a82f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a828 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638420.684266:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385308e00, rc 0) 00000100:00100000:1.0:1788638420.684435:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:5840:x1875523183605376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 384us (1687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638420.684441:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788638420.685604:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183605376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788638420.685643:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2a828 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a82f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638420.685655:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2a828 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a82f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638420.685730:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183605504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788638420.685779:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638420.685849:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c35f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788638420.685955:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183605504 00000100:00100000:1.0:1788638420.685963:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183605504 00000100:00100000:1.0:1788638420.686008:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788638420.686018:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:5840:x1875523183605504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788638420.686323:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:5840:x1875523183605504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 306us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638420.686331:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788638420.686545:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183605504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788638420.686592:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183605632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788638420.686635:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638420.686655:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738a4bb0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638420.686810:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183605632 00000100:00100000:1.0:1788638420.686815:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183605632 00000100:00100000:1.0:1788638420.686843:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788638420.686850:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:5840:x1875523183605632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788638420.686994:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:5840:x1875523183605632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638420.687000:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788638420.687162:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183605632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788638420.687847:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8479:1875523183605760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788638420.687893:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638420.687921:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738a4bbf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788638420.687983:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183605760 00000100:00100000:1.0:1788638420.687989:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183605760 00000100:00100000:1.0:1788638420.688025:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788638420.688032:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:8479:x1875523183605760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788638420.688309:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:8479:x1875523183605760:12345-0@lo:502:llog_process_th.0 Request processed in 277us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638420.688317:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788638420.688620:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8479:1875523183605760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788638420.688664:0:8479:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8479:1875523183605888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788638420.688703:0:8479:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638420.688757:0:8479:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738a4bbf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788638420.689219:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183605888 00000100:00100000:2.0:1788638420.689226:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183605888 00000100:00100000:2.0:1788638420.689274:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788638420.689282:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:8479:x1875523183605888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788638420.690665:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:8479:x1875523183605888:12345-0@lo:502:llog_process_th.0 Request processed in 1378us (1956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638420.690678:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788638420.691849:0:8479:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8479:1875523183605888:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788638420.691892:0:8479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788638420.692102:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788638420.692230:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788638420.692243:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2a828 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a82f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638420.692256:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2a828 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a82f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638420.692275:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788638420.692278:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788638420.692282:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788638420.692627:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fc600/0xa0b1f1e3b4b2a836 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638420.692638:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73813fc600/0xa0b1f1e3b4b2a836 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638420.692649:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73813fc600/0xa0b1f1e3b4b2a836 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638420.692674:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4659c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183606016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788638420.692739:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638420.692873:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73acdad780 going to sleep for 11 seconds 00000100:00100000:1.0:1788638420.695022:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183606016 00000100:00100000:1.0:1788638420.695034:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183606016 00000100:00100000:1.0:1788638420.695128:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788638420.695140:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:5840:x1875523183606016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788638420.695166:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638420.695188:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7385309200/0xa0b1f1e3b4b2a83d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a836 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638420.695214:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7385309200/0xa0b1f1e3b4b2a83d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a836 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638420.695225:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7385309200/0xa0b1f1e3b4b2a83d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a836 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638420.695245:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309200, rc 0) 00000100:00100000:1.0:1788638420.695348:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:5840:x1875523183606016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (2607us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638420.695354:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788638420.695464:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4659c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183606016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788638420.695485:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73813fc600/0xa0b1f1e3b4b2a836 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a83d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638420.695497:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73813fc600/0xa0b1f1e3b4b2a836 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a83d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638420.696039:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183606144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788638420.696082:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638420.696185:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c350c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638420.698755:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183606144 00000100:00100000:0.0:1788638420.698768:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183606144 00000100:00100000:1.0:1788638420.698956:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788638420.698969:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:5840:x1875523183606144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788638420.699942:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:5840:x1875523183606144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 972us (3854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638420.699954:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788638420.700052:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183606144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788638420.700131:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183606272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788638420.700191:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638420.700235:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c350c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638420.701820:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183606272 00000100:00100000:1.0:1788638420.701833:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183606272 00000100:00100000:1.0:1788638420.701895:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788638420.701905:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:5840:x1875523183606272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788638420.702727:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:5840:x1875523183606272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 820us (2532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638420.702738:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788638420.702873:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183606272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788638420.703820:0:8481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8481:1875523183606400:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788638420.703891:0:8481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638420.703915:0:8481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c35a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788638420.706151:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183606400 00000100:00100000:0.0:1788638420.706174:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183606400 00000100:00100000:0.0:1788638420.706239:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788638420.706251:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:8481:x1875523183606400:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638420.706529:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:8481:x1875523183606400:12345-0@lo:502:llog_process_th.0 Request processed in 279us (2636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638420.706537:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788638420.707861:0:8481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8481:1875523183606400:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788638420.710212:0:8481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788638420.710229:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638420.710232:0:8481:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788638420.710240:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788638420.710288:0:8481:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8481:1875523183606528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788638420.710441:0:8481:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638420.710499:0:8481:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7386723900 going to sleep for 11 seconds 00000100:00100000:2.0:1788638420.710724:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183606528 00000100:00100000:2.0:1788638420.710732:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183606528 00000100:00100000:2.0:1788638420.710806:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788638420.710815:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:8481:x1875523183606528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788638420.711399:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:8481:x1875523183606528:12345-0@lo:502:llog_process_th.0 Request processed in 583us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638420.711408:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788638420.711475:0:8481:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8481:1875523183606528:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788638420.711498:0:8481:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788638420.711508:0:8481:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638420.711510:0:8481:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788638420.711736:0:8481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1788638420.712096:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788638420.712198:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788638420.712209:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fc600/0xa0b1f1e3b4b2a836 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a83d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638420.712231:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73813fc600/0xa0b1f1e3b4b2a836 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a83d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638420.712241:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788638420.712244:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c7387a11800 from 39 10000000:01000000:2.0:1788638420.712247:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788638420.712279:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2a844 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638420.712287:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2a844 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638420.712375:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2a844 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638420.712398:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183606656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788638420.712445:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638420.712526:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c35d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788638420.713035:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183606656 00000100:00100000:1.0:1788638420.713043:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183606656 00000100:00100000:1.0:1788638420.713089:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788638420.713097:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:5840:x1875523183606656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788638420.713110:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638420.713211:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7385309a00/0xa0b1f1e3b4b2a84b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a844 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638420.713239:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7385309a00/0xa0b1f1e3b4b2a84b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a844 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638420.713250:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7385309a00/0xa0b1f1e3b4b2a84b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a844 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638420.713259:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309a00, rc 0) 00000100:00100000:1.0:1788638420.713383:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183606656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 286us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638420.713390:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788638420.713442:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183606656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788638420.713474:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2a844 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a84b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638420.713484:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2a844 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a84b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638420.713607:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183606784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788638420.713650:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638420.713685:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738a4bbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788638420.713853:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183606784 00000100:00100000:1.0:1788638420.713858:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183606784 00000100:00100000:1.0:1788638420.713919:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788638420.713927:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183606784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788638420.714182:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183606784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 256us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638420.714191:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788638420.714266:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183606784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788638420.714296:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183606912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788638420.714336:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638420.714887:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738a4bbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788638420.714981:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183606912 00000100:00100000:0.0:1788638420.714987:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183606912 00000100:00100000:0.0:1788638420.715018:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788638420.715026:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183606912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788638420.715208:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183606912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638420.715215:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788638420.715313:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183606912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788638420.716468:0:8483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8483:1875523183607040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788638420.716602:0:8483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638420.716670:0:8483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738a4bbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788638420.719098:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183607040 00000100:00100000:1.0:1788638420.719123:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183607040 00000100:00100000:1.0:1788638420.719192:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788638420.719203:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:8483:x1875523183607040:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788638420.722815:0:8483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8483:1875523183607040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788638420.723032:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:8483:x1875523183607040:12345-0@lo:502:llog_process_th.0 Request processed in 3829us (6428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638420.723045:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788638420.723207:0:8483:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8483:1875523183607168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788638420.723258:0:8483:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638420.723374:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183607168 00000100:00100000:0.0:1788638420.723381:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183607168 00000100:00100000:0.0:1788638420.723429:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788638420.723438:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:8483:x1875523183607168:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638420.723641:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:8483:x1875523183607168:12345-0@lo:502:llog_process_th.0 Request processed in 203us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638420.723648:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788638420.723705:0:8483:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738a4bbd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788638420.723721:0:8483:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8483:1875523183607168:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788638420.723741:0:8483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788638420.723962:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788638420.723981:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788638420.723990:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2a844 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a84b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638420.724001:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2a844 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a84b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638420.724011:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788638420.724013:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1788638420.724016:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788638420.724041:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fcc00/0xa0b1f1e3b4b2a852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638420.724050:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73813fcc00/0xa0b1f1e3b4b2a852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638420.724059:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73813fcc00/0xa0b1f1e3b4b2a852 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638420.724073:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4659c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183607296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788638420.724103:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638420.724142:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788638420.724205:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183607296 00000100:00100000:3.0:1788638420.724210:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183607296 00000100:00100000:3.0:1788638420.724234:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788638420.724242:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183607296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788638420.724251:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638420.724263:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73829f1800/0xa0b1f1e3b4b2a859 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a852 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638420.725051:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73829f1800/0xa0b1f1e3b4b2a859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a852 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638420.725066:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73829f1800/0xa0b1f1e3b4b2a859 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a852 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638420.725076:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73829f1800, rc 0) 00000100:00100000:3.0:1788638420.725130:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183607296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 889us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638420.725138:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1788638420.725209:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4659c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183607296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788638420.725224:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73813fcc00/0xa0b1f1e3b4b2a852 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a859 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638420.725234:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73813fcc00/0xa0b1f1e3b4b2a852 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a859 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638420.725286:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4659c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183607424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638420.725315:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638420.725352:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788638420.725399:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183607424 00000100:00100000:2.0:1788638420.725404:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183607424 00000100:00100000:2.0:1788638420.725439:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788638420.725447:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183607424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788638420.725694:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183607424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 246us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638420.725701:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788638420.726106:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4659c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183607424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788638420.726207:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183607552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788638420.726249:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638420.726279:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738a4bb300 going to sleep for 11 seconds 00000100:00100000:0.0:1788638420.726377:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183607552 00000100:00100000:0.0:1788638420.726382:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183607552 00000100:00100000:0.0:1788638420.726417:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1788638420.726424:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183607552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788638420.726576:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183607552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638420.726584:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788638420.726713:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183607552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788638420.727442:0:8484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8484:1875523183607680:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788638420.727489:0:8484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638420.727594:0:8484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738a4bbcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638420.727610:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183607680 00000100:00100000:0.0:1788638420.727615:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183607680 00000100:00100000:0.0:1788638420.727651:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788638420.727658:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:8484:x1875523183607680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638420.728254:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:8484:x1875523183607680:12345-0@lo:502:llog_process_th.0 Request processed in 593us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638420.728262:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788638420.728827:0:8484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8484:1875523183607680:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788638420.728862:0:8484:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788638420.728878:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638420.728881:0:8484:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788638420.728888:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788638420.728918:0:8484:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8484:1875523183607808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788638420.728968:0:8484:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638420.728996:0:8484:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c35000 going to sleep for 11 seconds 00000100:00100000:0.0:1788638420.729047:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183607808 00000100:00100000:0.0:1788638420.729052:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183607808 00000100:00100000:0.0:1788638420.729103:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788638420.729113:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:8484:x1875523183607808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638420.729318:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:8484:x1875523183607808:12345-0@lo:502:llog_process_th.0 Request processed in 206us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638420.729325:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788638420.729603:0:8484:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61fb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8484:1875523183607808:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788638420.729626:0:8484:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638420.729632:0:8484:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638420.729633:0:8484:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788638420.729638:0:8484:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1788638420.729879:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1788638420.729898:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788638420.729907:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fcc00/0xa0b1f1e3b4b2a852 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a859 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638420.729919:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73813fcc00/0xa0b1f1e3b4b2a852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a859 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638420.729930:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788638420.729933:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c738375b380 from 1 10000000:01000000:0.0:1788638420.729936:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788638420.729965:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fd200/0xa0b1f1e3b4b2a860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638420.729973:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73813fd200/0xa0b1f1e3b4b2a860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638420.729982:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73813fd200/0xa0b1f1e3b4b2a860 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638420.729998:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4659c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183607936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788638420.730034:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638420.730067:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32540 going to sleep for 11 seconds 00000100:00100000:1.0:1788638420.730207:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183607936 00000100:00100000:1.0:1788638420.730212:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183607936 00000100:00100000:1.0:1788638420.730248:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788638420.730256:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183607936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788638420.730265:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638420.730277:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7385308600/0xa0b1f1e3b4b2a867 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a860 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638420.730365:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7385308600/0xa0b1f1e3b4b2a867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a860 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638420.731026:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7385308600/0xa0b1f1e3b4b2a867 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a860 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638420.731039:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385308600, rc 0) 00000100:00100000:1.0:1788638420.731095:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:5840:x1875523183607936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 839us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638420.731101:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1788638420.731204:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4659c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183607936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788638420.731233:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73813fd200/0xa0b1f1e3b4b2a860 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a867 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638420.731244:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73813fd200/0xa0b1f1e3b4b2a860 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a867 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638420.731322:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183608064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788638420.731367:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638420.731401:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738a4bb180 going to sleep for 11 seconds 00000100:00100000:1.0:1788638420.731530:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183608064 00000100:00100000:1.0:1788638420.731537:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183608064 00000100:00100000:1.0:1788638420.731573:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1788638420.731581:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:5840:x1875523183608064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788638420.731928:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:5840:x1875523183608064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 347us (560us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788638420.731935:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788638420.734912:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183608064:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1788638420.734958:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788638420.734968:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fd200/0xa0b1f1e3b4b2a860 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a867 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638420.734979:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73813fd200/0xa0b1f1e3b4b2a860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a867 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638420.896041:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788638421.152104:0:8509:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdf5b14fd0 20000000:00000080:1.0:1788638421.152122:0:8509:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c73bf6ea400 uarg=0000000000000000 20000000:01000000:1.0:1788638421.152222:0:8509:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788638421.152228:0:8509:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788638421.152233:0:8509:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788638421.155801:0:8510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788638421.156467:0:8509:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788638421.172321:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788638421.172389:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788638421.172438:0:8509:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788638421.172455:0:8509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788638421.172473:0:8509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c73813fd800/0xa0b1f1e3b4b2a86e lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.172492:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7380030000/0xa0b1f1e3b4b2a637 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a630 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.172500:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c73829f1c00/0xa0b1f1e3b4b2a6b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a6ae expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.172506:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a710 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a709 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.172516:0:8509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c73829f1200/0xa0b1f1e3b4b2a7cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cf6 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.172523:0:8509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c73813fd800/0xa0b1f1e3b4b2a86e lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.172565:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c73829f1200/0xa0b1f1e3b4b2a7cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cf6 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.172581:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c73829f1200/0xa0b1f1e3b4b2a7cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cf6 expref: 9 pid: 5834 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638421.172596:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4659c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875523183608192:192.168.203.34@tcp:104: 00010000:00010000:0.0:1788638421.172709:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a710 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a709 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.172718:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a710 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a709 expref: 18 pid: 5837 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638421.172736:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875523183608320:0@lo:104: 00000100:00100000:0.0:1788638421.172778:0:8509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638421.172837:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183608320 00000100:00100000:0.0:1788638421.172844:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183608320 00000100:00100000:0.0:1788638421.172885:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788638421.172893:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:8509:x1875523183608320:12345-0@lo:104: 00010000:00010000:0.0:1788638421.172905:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a709 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a710 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.172946:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788638421.172952:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:8509:x1875523183608320:12345-0@lo:104: Request processed in 60us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638421.172959:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:0.0:1788638421.172990:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c73829f1c00/0xa0b1f1e3b4b2a6b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a6ae expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.172999:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c73829f1c00/0xa0b1f1e3b4b2a6b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a6ae expref: 18 pid: 5835 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638421.173007:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875523183608448:0@lo:104: 00000100:00100000:0.0:1788638421.173040:0:8509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638421.173063:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788638421.173070:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183608448 00000100:00100000:0.0:1788638421.173073:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183608448 00000100:00100000:0.0:1788638421.173090:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788638421.173095:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b488c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:8509:x1875523183608448:12345-0@lo:104: 00010000:00010000:0.0:1788638421.173103:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c7381684600/0xa0b1f1e3b4b2a6ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a6b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.173138:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788638421.173143:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b488c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:8509:x1875523183608448:12345-0@lo:104: Request processed in 47us (102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638421.173149:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1788638421.173205:0:8509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7380030000/0xa0b1f1e3b4b2a637 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a630 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.173214:0:8509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7380030000/0xa0b1f1e3b4b2a637 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a630 expref: 18 pid: 5834 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638421.173223:0:8509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875523183608576:0@lo:104: 00000100:00100000:0.0:1788638421.173243:0:8509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638421.173258:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183608576 00000100:00100000:0.0:1788638421.173261:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183608576 00000100:00100000:0.0:1788638421.173277:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788638421.173282:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:8509:x1875523183608576:12345-0@lo:104: 00010000:00010000:0.0:1788638421.173289:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6600/0xa0b1f1e3b4b2a630 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a637 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.173315:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788638421.173319:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:8509:x1875523183608576:12345-0@lo:104: Request processed in 38us (76us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638421.173325:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788638421.173340:0:8509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32300 going to sleep for 11 seconds 00000100:00100000:0.0:1788638421.173359:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875523183608320:0@lo:104: 00000100:00100000:0.0:1788638421.173367:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875523183608448:0@lo:104: 00000100:00100000:0.0:1788638421.173373:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875523183608576:0@lo:104: 00010000:00010000:2.0:1788638421.173569:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788638421.173575:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a709 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a710 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.173583:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7400 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:2.0:1788638421.173586:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a709 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a710 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.173594:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a709 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a710 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788638421.173601:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a709 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a710 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638421.173607:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788638421.173639:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a709 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a710 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.173646:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788638421.173664:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a709 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a710 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.173671:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a709 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a710 expref: -99 pid: 7632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.173683:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788638421.173687:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7381684600/0xa0b1f1e3b4b2a6ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a6b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.173692:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7381684600 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:2.0:1788638421.173695:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7381684600/0xa0b1f1e3b4b2a6ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a6b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.173701:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7381684600/0xa0b1f1e3b4b2a6ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a6b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788638421.173706:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7381684600/0xa0b1f1e3b4b2a6ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a6b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638421.173712:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788638421.173724:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7381684600/0xa0b1f1e3b4b2a6ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a6b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.173730:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788638421.173735:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7381684600/0xa0b1f1e3b4b2a6ae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a6b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.173751:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7381684600/0xa0b1f1e3b4b2a6ae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a6b5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.173761:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638421.173764:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6600/0xa0b1f1e3b4b2a630 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a637 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.173769:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6600 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:2.0:1788638421.173773:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6600/0xa0b1f1e3b4b2a630 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a637 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.173780:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6600/0xa0b1f1e3b4b2a630 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a637 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788638421.173805:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6600/0xa0b1f1e3b4b2a630 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a637 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638421.173810:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788638421.173824:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6600/0xa0b1f1e3b4b2a630 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a637 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.173829:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788638421.173842:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6600/0xa0b1f1e3b4b2a630 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a637 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.173849:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6600/0xa0b1f1e3b4b2a630 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a637 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.173861:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638421.173867:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638421.173869:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638421.173875:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638421.173886:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183608704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788638421.173918:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638421.173949:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788638421.173954:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183608832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788638421.173973:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638421.173993:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183608960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788638421.174010:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638421.174035:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183608704 00000100:00100000:2.0:1788638421.174038:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183608704 00010000:00010000:2.0:1788638421.174058:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a710 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a709 expref: 19 pid: 5837 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638421.174073:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183608832 00000100:00100000:2.0:1788638421.174075:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183608832 00010000:00010000:2.0:1788638421.174083:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c73829f1c00/0xa0b1f1e3b4b2a6b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a6ae expref: 20 pid: 5835 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638421.174092:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183608960 00000100:00100000:2.0:1788638421.174093:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183608960 00010000:00010000:2.0:1788638421.174102:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7380030000/0xa0b1f1e3b4b2a637 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a630 expref: 21 pid: 5834 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638421.174112:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788638421.174117:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+21:3291:x1875523183608704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788638421.174127:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638421.174131:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a710 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a709 expref: 21 pid: 5837 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.174145:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a710 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a709 expref: 21 pid: 5837 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.174171:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7381685000/0xa0b1f1e3b4b2a710 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a709 expref: 21 pid: 5837 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.174183:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638421.174211:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+20:3291:x1875523183608704:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638421.174216:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788638421.174229:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788638421.174234:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3291:x1875523183608832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788638421.174241:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638421.174245:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c73829f1c00/0xa0b1f1e3b4b2a6b5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a6ae expref: 19 pid: 5835 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.174253:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c73829f1c00/0xa0b1f1e3b4b2a6b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a6ae expref: 19 pid: 5835 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.174261:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73829f1c00/0xa0b1f1e3b4b2a6b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a6ae expref: 19 pid: 5835 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.174268:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638421.174287:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:3291:x1875523183608832:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638421.174292:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788638421.174302:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788638421.174308:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:3293:x1875523183608960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788638421.174320:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638421.174324:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7380030000/0xa0b1f1e3b4b2a637 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a630 expref: 17 pid: 5834 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.174331:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7380030000/0xa0b1f1e3b4b2a637 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a630 expref: 17 pid: 5834 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.174340:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7380030000/0xa0b1f1e3b4b2a637 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a630 expref: 17 pid: 5834 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.174349:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638421.174374:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:3293:x1875523183608960:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638421.174380:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788638421.174410:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183608960:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788638421.174431:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183608832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788638421.174438:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183608704:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788638421.178678:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638421.179690:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638421.179947:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174143488 00000100:00100000:3.0:1788638421.179957:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174143488 00010000:00010000:3.0:1788638421.179993:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c73829f1200/0xa0b1f1e3b4b2a7cd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cf6 expref: 10 pid: 5834 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638421.180066:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 24 00000100:00100000:3.0:1788638421.180078:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55273f9a-386c-4321-9748-c194b047efe8+10:2365:x1875523174143488:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788638421.180259:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638421.180268:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c73829f1200/0xa0b1f1e3b4b2a7cd lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cf6 expref: 10 pid: 5834 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638421.180282:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c73829f1200/0xa0b1f1e3b4b2a7cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cf6 expref: 10 pid: 5834 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638421.181233:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73829f1200/0xa0b1f1e3b4b2a7cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cf6 expref: 10 pid: 5834 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638421.181233:0:8509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4659c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8509:1875523183608192:192.168.203.34@tcp:104: 00010000:00010000:3.0:1788638421.181252:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c73813fd800/0xa0b1f1e3b4b2a86e lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638421.181273:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73813fd800/0xa0b1f1e3b4b2a86e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.181284:0:8509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c73813fd800/0xa0b1f1e3b4b2a86e lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638421.181289:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c73813fd800/0xa0b1f1e3b4b2a86e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.181292:0:8509:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9c73813fd800/0xa0b1f1e3b4b2a86e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638421.181296:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c73813fd800/0xa0b1f1e3b4b2a86e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.181299:0:8509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c73813fd800/0xa0b1f1e3b4b2a86e lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638421.181303:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c73813fd800/0xa0b1f1e3b4b2a86e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638421.181309:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c73813fd800/0xa0b1f1e3b4b2a86e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638421.181314:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fd800 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638421.181317:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c73813fd800/0xa0b1f1e3b4b2a86e lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638421.181324:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c73813fd800/0xa0b1f1e3b4b2a86e lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638421.181333:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c73813fd800/0xa0b1f1e3b4b2a86e lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638421.181701:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73813fd800/0xa0b1f1e3b4b2a86e lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638421.181718:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638421.181797:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55273f9a-386c-4321-9748-c194b047efe8+9:2365:x1875523174143488:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 1705us (2099us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638421.181817:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 24 10000000:01000000:0.0:1788638421.856415:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788638421.856423:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c73b4c0d800 from 4 10000000:01000000:0.0:1788638421.856429:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788638421.856477:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2a875 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.856490:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2a875 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.856500:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2a875 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638421.856525:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183609088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788638421.856594:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638421.856669:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d90a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788638421.856884:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183609088 00000100:00100000:1.0:1788638421.856892:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183609088 00000100:00100000:1.0:1788638421.856945:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788638421.856955:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:5840:x1875523183609088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788638421.856968:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638421.856983:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2a87c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a875 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638421.857004:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2a87c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a875 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638421.857014:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2a87c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a875 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638421.857023:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309400, rc 0) 00000100:00100000:1.0:1788638421.857070:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183609088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638421.857076:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1788638421.857200:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183609088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788638421.857215:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2a875 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a87c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.857242:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2a875 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a87c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638421.857299:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183609216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638421.857329:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638421.857365:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d90a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788638421.857460:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183609216 00000100:00100000:1.0:1788638421.857470:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183609216 00000100:00100000:1.0:1788638421.857499:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788638421.857506:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183609216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788638421.857764:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183609216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638421.857772:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1788638421.858024:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183609216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638421.858053:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183609344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788638421.858090:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638421.858116:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d90a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788638421.858168:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183609344 00000100:00100000:1.0:1788638421.858173:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183609344 00000100:00100000:1.0:1788638421.858206:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788638421.858212:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183609344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788638421.858421:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183609344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 209us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638421.858429:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788638421.858504:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183609344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788638421.859651:0:8530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8530:1875523183609472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638421.859723:0:8530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638421.859759:0:8530:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d90240 going to sleep for 11 seconds 00000100:00100000:1.0:1788638421.860462:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183609472 00000100:00100000:1.0:1788638421.860470:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183609472 00000100:00100000:1.0:1788638421.860525:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1788638421.860535:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:8530:x1875523183609472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638421.861007:0:8530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8530:1875523183609472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788638421.861042:0:8530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788638421.861052:0:8530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638421.861054:0:8530:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788638421.861063:0:8530:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c73b4c0d800 00000020:00000080:0.0:1788638421.861066:0:8530:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788638421.861165:0:8530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8530:1875523183609600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638421.861211:0:8530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638421.861244:0:8530:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d90240 going to sleep for 11 seconds 00000100:00100000:3.0:1788638421.861298:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183609600 00000100:00100000:3.0:1788638421.861303:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183609600 00000100:00100000:3.0:1788638421.861338:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788638421.861346:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:8530:x1875523183609600:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788638421.861487:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:8530:x1875523183609600:12345-0@lo:502:llog_process_th.0 Request processed in 141us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638421.861495:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1788638421.863631:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:8530:x1875523183609472:12345-0@lo:502:llog_process_th.0 Request processed in 250us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638421.863647:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788638421.863835:0:8530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8530:1875523183609600:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788638421.863884:0:8530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638421.863892:0:8530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638421.863895:0:8530:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788638421.863902:0:8530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788638421.864079:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788638421.864101:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788638421.864112:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2a875 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a87c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.864123:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2a875 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a87c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638421.864136:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788638421.864159:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c73bce5d800 from 4 10000000:01000000:2.0:1788638421.864162:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788638421.864194:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a883 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.864203:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a883 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.864213:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a883 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638421.864232:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183609728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788638421.864294:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638421.864328:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c35d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788638421.866049:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183609728 00000100:00100000:1.0:1788638421.866063:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183609728 00000100:00100000:1.0:1788638421.866116:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788638421.866127:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183609728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788638421.866143:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638421.866171:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7385309600/0xa0b1f1e3b4b2a88a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a883 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638421.866208:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7385309600/0xa0b1f1e3b4b2a88a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a883 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638421.866219:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7385309600/0xa0b1f1e3b4b2a88a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a883 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638421.866229:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309600, rc 0) 00000100:00100000:1.0:1788638421.866305:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183609728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (2011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638421.866311:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788638421.868176:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183609728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788638421.868218:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a883 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a88a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638421.868231:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a883 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a88a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638421.868318:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183609856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788638421.868373:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638421.868406:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738a4bb300 going to sleep for 11 seconds 00000100:00100000:1.0:1788638421.871307:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183609856 00000100:00100000:1.0:1788638421.871322:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183609856 00000100:00100000:1.0:1788638421.871378:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788638421.871389:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183609856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788638421.871697:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183609856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (3322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638421.871706:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788638421.871777:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183609856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788638421.871858:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183609984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788638421.872204:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638421.872241:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7390939c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788638421.874315:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183609984 00000100:00100000:0.0:1788638421.874328:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183609984 00000100:00100000:0.0:1788638421.874652:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788638421.874663:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183609984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788638421.875552:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183609984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 887us (3344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638421.875563:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788638421.875639:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183609984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788638421.875855:0:8533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8533:1875523183610112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638421.875902:0:8533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638421.875935:0:8533:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d90180 going to sleep for 11 seconds 00000100:00100000:0.0:1788638421.877325:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183610112 00000100:00100000:0.0:1788638421.877335:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183610112 00000100:00100000:0.0:1788638421.877437:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788638421.877447:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:8533:x1875523183610112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638421.877674:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:8533:x1875523183610112:12345-0@lo:502:llog_process_th.0 Request processed in 228us (1772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638421.877681:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788638421.877977:0:8533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8533:1875523183610112:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788638421.878008:0:8533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788638421.878017:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638421.878026:0:8533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788638421.878034:0:8533:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c73bce5d800 00000020:00000080:0.0:1788638421.878037:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788638421.879329:0:8533:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8533:1875523183610240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638421.879405:0:8533:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638421.879446:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183610240 00000100:00100000:0.0:1788638421.879452:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183610240 00000100:00100000:0.0:1788638421.879491:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788638421.879498:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:8533:x1875523183610240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638421.879683:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:8533:x1875523183610240:12345-0@lo:502:llog_process_th.0 Request processed in 185us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638421.879691:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788638421.879742:0:8533:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d90180 going to sleep for 11 seconds 00000100:00100000:0.0:1788638421.879759:0:8533:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8533:1875523183610240:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788638421.879795:0:8533:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638421.879803:0:8533:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638421.879805:0:8533:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788638421.879811:0:8533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788638421.879867:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788638421.879888:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788638421.879899:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a883 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a88a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.879910:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a883 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a88a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638421.879920:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788638421.879922:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7387a11800 from 4 10000000:01000000:0.0:1788638421.879925:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788638421.879955:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fda00/0xa0b1f1e3b4b2a891 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.879963:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73813fda00/0xa0b1f1e3b4b2a891 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.879972:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73813fda00/0xa0b1f1e3b4b2a891 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638421.879985:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183610368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788638421.880014:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638421.880028:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d90180 going to sleep for 11 seconds 00000100:00100000:0.0:1788638421.880045:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183610368 00000100:00100000:0.0:1788638421.880049:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183610368 00000100:00100000:0.0:1788638421.880072:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788638421.880079:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183610368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788638421.880087:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638421.880101:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2a898 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a891 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.880260:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2a898 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a891 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.880271:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2a898 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a891 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.880280:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73813fce00, rc 0) 00000100:00100000:0.0:1788638421.880311:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:5840:x1875523183610368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 232us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638421.880317:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788638421.880480:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183610368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788638421.880492:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73813fda00/0xa0b1f1e3b4b2a891 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a898 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.880501:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73813fda00/0xa0b1f1e3b4b2a891 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a898 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638421.880544:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183610496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638421.880581:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638421.880595:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d90180 going to sleep for 11 seconds 00000100:00100000:0.0:1788638421.880608:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183610496 00000100:00100000:0.0:1788638421.880611:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183610496 00000100:00100000:0.0:1788638421.880634:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788638421.880640:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:5840:x1875523183610496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638421.880869:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:5840:x1875523183610496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 229us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638421.880877:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1788638421.880910:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183610496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638421.880932:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183610624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788638421.880966:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638421.880979:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d90180 going to sleep for 11 seconds 00000100:00100000:0.0:1788638421.880989:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183610624 00000100:00100000:0.0:1788638421.880992:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183610624 00000100:00100000:0.0:1788638421.881013:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788638421.881019:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:5840:x1875523183610624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788638421.882521:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:5840:x1875523183610624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1495us (1546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638421.882540:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1788638421.882608:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183610624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788638421.884985:0:8534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8534:1875523183610752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638421.885077:0:8534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638421.885482:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183610752 00000100:00100000:0.0:1788638421.885490:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183610752 00000100:00100000:0.0:1788638421.885534:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788638421.885544:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:8534:x1875523183610752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638421.885771:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:8534:x1875523183610752:12345-0@lo:502:llog_process_th.0 Request processed in 228us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638421.885779:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788638421.885848:0:8534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d90300 going to sleep for 11 seconds 00000100:00100000:0.0:1788638421.885871:0:8534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8534:1875523183610752:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788638421.885900:0:8534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788638421.885911:0:8534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638421.885913:0:8534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788638421.885922:0:8534:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c7387a11800 00000020:00000080:0.0:1788638421.885924:0:8534:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788638421.888426:0:8534:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8534:1875523183610880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638421.888501:0:8534:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638421.888539:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183610880 00000100:00100000:0.0:1788638421.888546:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183610880 00000100:00100000:0.0:1788638421.888590:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788638421.888599:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:8534:x1875523183610880:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638421.889025:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:8534:x1875523183610880:12345-0@lo:502:llog_process_th.0 Request processed in 426us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638421.889040:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788638421.889275:0:8534:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d90300 going to sleep for 11 seconds 00000100:00100000:0.0:1788638421.889296:0:8534:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:8534:1875523183610880:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788638421.889327:0:8534:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638421.889335:0:8534:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638421.889337:0:8534:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788638421.889343:0:8534:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788638421.889465:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788638421.889484:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788638421.889494:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fda00/0xa0b1f1e3b4b2a891 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a898 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638421.889506:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73813fda00/0xa0b1f1e3b4b2a891 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a898 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638421.921684:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638422.246171:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183611392:0@lo:400:kworker.0 00000100:00100000:0.0:1788638422.246176:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183611008:0@lo:400:kworker.0 00000100:00100000:0.0:1788638422.249867:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638422.249934:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183611520:0@lo:400:kworker.0 00000100:00100000:0.0:1788638422.249980:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638422.250031:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183611264:0@lo:400:kworker.0 00000100:00100000:0.0:1788638422.250059:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638422.250080:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788638422.250088:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183611136:0@lo:400:kworker.0 00000100:00100000:0.0:1788638422.250113:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638422.250135:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183611648:0@lo:400:kworker.0 00000100:00100000:0.0:1788638422.250174:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638422.250220:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183611008 00000100:00100000:0.0:1788638422.250227:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183611008 00000100:00100000:0.0:1788638422.250269:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788638422.250277:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183611008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638422.250341:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183611008:12345-0@lo:400:kworker.0 Request processed in 64us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638422.250348:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788638422.250637:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183611520 00000100:00100000:0.0:1788638422.250642:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183611520 00000100:00100000:0.0:1788638422.250740:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183611264 00000100:00100000:0.0:1788638422.250745:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183611264 00000100:00100000:0.0:1788638422.250759:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183611136 00000100:00100000:0.0:1788638422.250761:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183611136 00000100:00100000:0.0:1788638422.250774:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788638422.250780:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183611520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638422.250833:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183611520:12345-0@lo:400:kworker.0 Request processed in 53us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638422.250840:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788638422.250854:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788638422.250859:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183611264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638422.250890:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183611264:12345-0@lo:400:kworker.0 Request processed in 30us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638422.250895:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788638422.250907:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788638422.250912:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183611136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638422.250937:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183611136:12345-0@lo:400:kworker.0 Request processed in 26us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638422.250953:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788638422.250982:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183611648 00000100:00100000:0.0:1788638422.250986:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183611648 00000100:00100000:0.0:1788638422.251013:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788638422.251019:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183611648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638422.251052:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183611648:12345-0@lo:400:kworker.0 Request processed in 33us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638422.251058:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788638422.251076:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788638422.251081:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638422.251113:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183611136:0@lo:400:kworker.0 00010000:00080000:0.0:1788638422.251129:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73c09a6d80 x1875523183611648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638422.251139:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183611648:0@lo:400:kworker.0 00000100:00100000:0.0:1788638422.251161:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183611264:0@lo:400:kworker.0 00000100:00100000:0.0:1788638422.251204:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183611008:0@lo:400:kworker.0 00000100:00100000:0.0:1788638422.251215:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183611520:0@lo:400:kworker.0 00000100:00100000:1.0:1788638422.254590:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638422.254834:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183611392 00000100:00100000:1.0:1788638422.254843:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183611392 00000100:00100000:1.0:1788638422.254909:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788638422.254920:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183611392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638422.254980:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183611392:12345-0@lo:400:kworker.0 Request processed in 63us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638422.254989:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788638422.255011:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788638422.255042:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73c09a4e00 x1875523183611392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638438 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638422.255056:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183611392:0@lo:400:kworker.0 00000100:00100000:2.0:1788638422.752721:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183611776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788638422.752838:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638422.753112:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183611776 00000100:00100000:3.0:1788638422.753123:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183611776 00000100:00100000:3.0:1788638422.753184:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788638422.753194:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183611776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788638422.753230:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788638422.753282:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183611776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638422.753289:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788638422.753337:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73837a5180 x1875523183611776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638438 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638422.753356:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183611776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788638422.801046:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638422.801184:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174143616 00000100:00100000:0.0:1788638422.801195:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174143616 00000100:00100000:0.0:1788638422.801258:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 187 00000100:00100000:0.0:1788638422.801268:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+9:5608:x1875523174143616:12345-192.168.203.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788638422.801283:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638422.801300:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2a89f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434d35 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638422.801339:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2a89f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d35 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638422.801351:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2a89f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d35 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638422.801362:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73813fd000, rc 0) 00000100:00100000:0.0:1788638422.801421:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+10:5608:x1875523174143616:12345-192.168.203.34@tcp:101:ll_cfg_requeue.0 Request processed in 153us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638422.801428:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 187 00000100:00100000:2.0:1788638422.811934:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638422.812059:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174143744 00000100:00100000:0.0:1788638422.812070:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174143744 00000100:00100000:0.0:1788638422.812131:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 188 00000100:00100000:0.0:1788638422.812156:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+10:5608:x1875523174143744:12345-192.168.203.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638422.812434:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+10:5608:x1875523174143744:12345-192.168.203.34@tcp:501:ll_cfg_requeue.0 Request processed in 279us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638422.812442:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 188 00000100:00100000:3.0:1788638422.814565:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638422.814654:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174143872 00000100:00100000:2.0:1788638422.814664:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174143872 00000100:00100000:2.0:1788638422.814714:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 189 00000100:00100000:2.0:1788638422.814724:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+10:5608:x1875523174143872:12345-192.168.203.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788638422.814962:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+10:5608:x1875523174143872:12345-192.168.203.34@tcp:503:ll_cfg_requeue.0 Request processed in 237us (404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638422.814971:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 189 00000100:00100000:3.0:1788638422.819336:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638422.819815:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174144000 00000100:00100000:0.0:1788638422.819826:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174144000 00000100:00100000:0.0:1788638422.819877:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 190 00000100:00100000:0.0:1788638422.819887:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+10:6139:x1875523174144000:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788638422.820833:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+10:6139:x1875523174144000:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 874us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638422.820842:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 190 00000100:00100000:2.0:1788638422.826453:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638422.826868:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174144128 00000100:00100000:1.0:1788638422.826880:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174144128 00000100:00100000:1.0:1788638422.826937:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 191 00000100:00100000:1.0:1788638422.826949:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+10:6139:x1875523174144128:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788638422.827365:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+10:6139:x1875523174144128:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 418us (1010us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638422.827375:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 191 00010000:00010000:3.0:1788638422.950290:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638423.968145:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638424.322867:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638424.322909:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638424.322936:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174144256 00000100:00100000:3.0:1788638424.322943:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638424.322945:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174144256 00000100:00100000:3.0:1788638424.322986:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638424.323000:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 192 00000100:00100000:3.0:1788638424.323014:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174144512 00000100:00100000:3.0:1788638424.323019:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174144512 00000100:00100000:2.0:1788638424.323025:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+10:2364:x1875523174144256:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638424.323061:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174144640 00000100:00100000:3.0:1788638424.323066:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174144640 00000100:00100000:3.0:1788638424.323086:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 17 00000100:00100000:2.0:1788638424.323093:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+10:2364:x1875523174144256:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 71us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638424.323097:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2364:x1875523174144512:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638424.323107:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 192 00000100:00100000:3.0:1788638424.323154:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2364:x1875523174144512:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 59us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638424.323163:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 17 00000100:00100000:3.0:1788638424.323179:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 18 00000100:00100000:3.0:1788638424.323186:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2364:x1875523174144640:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638424.323212:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2364:x1875523174144640:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 28us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638424.323219:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 18 00000100:00080000:3.0:1788638424.323239:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788638424.323244:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788638424.323423:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174144384 00000100:00100000:1.0:1788638424.323428:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174144384 00000100:00100000:1.0:1788638424.323477:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 33 00000100:00100000:1.0:1788638424.323485:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174144384:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638424.323532:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174144384:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 47us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638424.323540:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 33 00000100:00080000:3.0:1788638424.323645:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788638424.998323:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638425.318710:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183611904:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788638425.318803:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638425.318883:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183611904 00000100:00100000:3.0:1788638425.318891:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183611904 00000100:00100000:3.0:1788638425.318966:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788638425.318976:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183611904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788638425.319012:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788638425.319067:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183611904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638425.319075:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1788638425.319114:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73ad39f800 x1875523183611904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638425.319147:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183611904:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788638425.319413:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788638426.018006:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638427.039918:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638427.360057:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183612416:0@lo:400:kworker.0 00000100:00100000:0.0:1788638427.360149:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638427.360214:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788638427.360221:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183612032:0@lo:400:kworker.0 00000100:00100000:0.0:1788638427.360254:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638427.360277:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183612544:0@lo:400:kworker.0 00000100:00100000:0.0:1788638427.360303:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638427.360329:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183612160:0@lo:400:kworker.0 00000100:00100000:0.0:1788638427.360353:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638427.360371:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7282fff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183612672:0@lo:400:kworker.0 00000100:00100000:0.0:1788638427.360389:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638427.360403:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638427.360408:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183612288:0@lo:400:kworker.0 00000100:00100000:0.0:1788638427.360428:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638427.360471:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183612416 00000100:00100000:0.0:1788638427.360479:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183612416 00000100:00100000:0.0:1788638427.360525:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183612672 00000100:00100000:0.0:1788638427.360528:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183612672 00000100:00100000:0.0:1788638427.360545:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788638427.360553:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183612416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638427.360603:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183612416:12345-0@lo:400:kworker.0 Request processed in 50us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638427.360610:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788638427.360625:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788638427.360631:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183612672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638427.360673:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183612672:12345-0@lo:400:kworker.0 Request processed in 42us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638427.360679:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788638427.360696:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183612544 00000100:00100000:0.0:1788638427.360699:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183612544 00000100:00100000:0.0:1788638427.360721:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183612160 00000100:00100000:0.0:1788638427.360724:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183612160 00000100:00100000:0.0:1788638427.360733:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183612288 00000100:00100000:0.0:1788638427.360735:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183612288 00000100:00100000:0.0:1788638427.360747:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788638427.360752:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183612544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638427.360780:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183612544:12345-0@lo:400:kworker.0 Request processed in 27us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638427.360812:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788638427.360823:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788638427.360830:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183612160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638427.360857:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183612160:12345-0@lo:400:kworker.0 Request processed in 28us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638427.360862:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788638427.360873:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788638427.360878:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183612288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638427.360902:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183612288:12345-0@lo:400:kworker.0 Request processed in 24us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638427.360908:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788638427.360953:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183612288:0@lo:400:kworker.0 00000100:00100000:0.0:1788638427.360966:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183612160:0@lo:400:kworker.0 00010000:00080000:0.0:1788638427.360987:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7282fff800 x1875523183612672/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638427.360996:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7282fff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183612672:0@lo:400:kworker.0 00000100:00100000:0.0:1788638427.361024:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183612544:0@lo:400:kworker.0 00010000:00080000:0.0:1788638427.361033:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73837a5180 x1875523183612416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638443 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638427.361041:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183612416:0@lo:400:kworker.0 00000100:00100000:2.0:1788638427.361378:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183612032 00000100:00100000:2.0:1788638427.361384:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183612032 00000100:00100000:2.0:1788638427.361421:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:2.0:1788638427.361428:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183612032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638427.361482:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183612032:12345-0@lo:400:kworker.0 Request processed in 54us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638427.361488:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00080000:2.0:1788638427.361517:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788638427.361523:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788638427.361525:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788638427.361543:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183612032:0@lo:400:kworker.0 00000100:00100000:3.0:1788638427.876924:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7282fff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183612800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788638427.876996:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638427.877112:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183612800 00000100:00100000:0.0:1788638427.877120:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183612800 00000100:00100000:0.0:1788638427.877170:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788638427.877178:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183612800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788638427.877213:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638427.877260:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183612800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638427.877268:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1788638427.877302:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7282fff800 x1875523183612800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638443 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638427.877321:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7282fff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183612800:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788638428.064000:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788638429.027016:0:8810:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg334-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1788638429.087920:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638429.443802:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638429.443917:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174144896 00000100:00100000:1.0:1788638429.443938:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174144896 00000100:00100000:1.0:1788638429.444132:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 37 00000100:00100000:1.0:1788638429.444142:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2365:x1875523174144896:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638429.444214:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00080000:2.0:1788638429.444222:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638429.444253:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174145152 00000100:00100000:3.0:1788638429.444254:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638429.444259:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174145152 00000100:00100000:3.0:1788638429.444297:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638429.444405:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2365:x1875523174144896:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 264us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638429.444414:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 37 00000100:00100000:0.0:1788638429.445330:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174144768 00000100:00100000:0.0:1788638429.445337:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174144768 00000100:00100000:0.0:1788638429.446140:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 194 00000100:00100000:0.0:1788638429.446151:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+10:2365:x1875523174144768:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638429.446200:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+10:2365:x1875523174144768:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 51us (1948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638429.446222:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 194 00000100:00100000:2.0:1788638429.446300:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174145024 00000100:00100000:2.0:1788638429.446306:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174145024 00000100:00100000:3.0:1788638429.446376:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 21 00000100:00100000:3.0:1788638429.446388:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2365:x1875523174145152:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638429.446420:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2365:x1875523174145152:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 36us (2208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638429.446434:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 21 00000100:00100000:2.0:1788638429.449963:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 22 00000100:00100000:2.0:1788638429.449980:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2365:x1875523174145024:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638429.450050:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2365:x1875523174145024:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 77us (5753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638429.450074:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 22 00000100:00080000:3.0:1788638429.452562:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788638429.452572:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788638430.112934:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638430.432044:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788638430.432067:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183612928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788638430.432225:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638430.436380:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183612928 00000100:00100000:3.0:1788638430.436395:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183612928 00000100:00100000:3.0:1788638430.436487:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788638430.436499:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282fff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183612928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788638430.436538:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788638430.436625:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282fff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183612928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (4399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638430.436632:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1788638430.436680:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73ad39d180 x1875523183612928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638430.436701:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183612928:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788638430.437334:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788638431.136457:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638432.160721:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638432.479983:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7282fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183613440:0@lo:400:kworker.0 00000100:00100000:0.0:1788638432.480051:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638432.480127:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788638432.480133:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7282ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183613056:0@lo:400:kworker.0 00000100:00100000:0.0:1788638432.480164:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638432.480197:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7282fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183613568:0@lo:400:kworker.0 00000100:00100000:0.0:1788638432.480221:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638432.480246:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7282ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183613184:0@lo:400:kworker.0 00000100:00100000:0.0:1788638432.480268:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638432.480283:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7282fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183613696:0@lo:400:kworker.0 00000100:00100000:0.0:1788638432.480303:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638432.480320:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638432.480324:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7282ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183613312:0@lo:400:kworker.0 00000100:00100000:0.0:1788638432.480345:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638432.480388:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183613440 00000100:00100000:0.0:1788638432.480395:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183613440 00000100:00100000:0.0:1788638432.480448:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183613696 00000100:00100000:0.0:1788638432.480451:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183613696 00000100:00100000:0.0:1788638432.480469:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788638432.480476:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183613440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638432.480533:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183613440:12345-0@lo:400:kworker.0 Request processed in 57us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638432.480541:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788638432.480557:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788638432.480564:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183613696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638432.480593:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183613696:12345-0@lo:400:kworker.0 Request processed in 30us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638432.480598:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788638432.480614:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183613568 00000100:00100000:0.0:1788638432.480617:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183613568 00000100:00100000:0.0:1788638432.480639:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183613184 00000100:00100000:0.0:1788638432.480641:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183613184 00000100:00100000:0.0:1788638432.480650:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183613312 00000100:00100000:0.0:1788638432.480652:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183613312 00000100:00100000:0.0:1788638432.480667:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788638432.480672:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183613568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638432.480700:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183613568:12345-0@lo:400:kworker.0 Request processed in 28us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638432.480706:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788638432.480717:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788638432.480722:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183613184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638432.480746:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183613184:12345-0@lo:400:kworker.0 Request processed in 24us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638432.480752:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788638432.480762:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788638432.480768:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183613312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638432.480826:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183613312:12345-0@lo:400:kworker.0 Request processed in 58us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638432.480832:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:0.0:1788638432.480851:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788638432.480856:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788638432.480858:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788638432.480882:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7282ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183613312:0@lo:400:kworker.0 00000100:00100000:0.0:1788638432.480893:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7282ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183613184:0@lo:400:kworker.0 00010000:00080000:0.0:1788638432.480902:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7282fffb80 x1875523183613696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638432.480912:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7282fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183613696:0@lo:400:kworker.0 00000100:00100000:0.0:1788638432.480940:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7282fff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183613568:0@lo:400:kworker.0 00010000:00080000:0.0:1788638432.480948:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7282fff100 x1875523183613440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638432.480956:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7282fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183613440:0@lo:400:kworker.0 00000100:00100000:1.0:1788638432.481415:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183613056 00000100:00100000:1.0:1788638432.481421:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183613056 00000100:00100000:1.0:1788638432.481453:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788638432.481459:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183613056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638432.481497:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183613056:12345-0@lo:400:kworker.0 Request processed in 38us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638432.481503:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788638432.481540:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7282ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183613056:0@lo:400:kworker.0 00000100:00100000:2.0:1788638432.991929:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7282fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183613824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788638432.991996:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638432.997641:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183613824 00000100:00100000:1.0:1788638432.997658:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183613824 00000100:00100000:1.0:1788638432.997735:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788638432.997748:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183613824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788638432.997814:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788638432.997898:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183613824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (5901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638432.997905:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788638432.997937:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7282fff100 x1875523183613824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638448 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638432.997958:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7282fff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183613824:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788638433.190120:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638434.217147:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788638434.400458:0:9054:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg334-server.virtnet: executing yml_node 00000100:00100000:1.0:1788638434.582646:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638434.582699:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638434.582735:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638434.582760:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174145408 00000100:00100000:1.0:1788638434.582768:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174145408 00000100:00100000:1.0:1788638434.582850:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 41 00000100:00100000:1.0:1788638434.582859:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174145408:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638434.582924:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174145408:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 66us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638434.582931:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 41 00000100:00100000:1.0:1788638434.582953:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174145536 00000100:00100000:1.0:1788638434.582956:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174145536 00000100:00100000:1.0:1788638434.582981:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:1.0:1788638434.582987:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2363:x1875523174145536:12345-192.168.203.34@tcp:9:kworker.0 00000020:00000080:1.0:1788638434.583010:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a7db 00000100:00080000:1.0:1788638434.583029:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9c72833bf800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788638434.583073:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788638434.583371:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+2:2363:x1875523174145536:12345-192.168.203.34@tcp:9:kworker.0 Request processed in 383us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638434.583525:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00080000:1.0:1788638434.583545:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788638434.583550:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788638434.583661:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638434.584030:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174145280 00000100:00100000:3.0:1788638434.584037:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174145280 00000100:00100000:3.0:1788638434.584091:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 196 00000100:00100000:3.0:1788638434.584099:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+10:2364:x1875523174145280:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638434.584140:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+10:2364:x1875523174145280:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 42us (1503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638434.584146:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 196 00000100:00100000:0.0:1788638434.597208:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638434.597323:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174145664 00000100:00100000:3.0:1788638434.597333:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174145664 00000100:00080000:0.0:1788638434.598132:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788638434.598200:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 11 00000100:00100000:3.0:1788638434.598212:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2363:x1875523174145664:12345-192.168.203.34@tcp:9:kworker.0 00000020:00000080:3.0:1788638434.598251:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a7e2 00000100:00080000:3.0:1788638434.598261:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9c72833be800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788638434.598309:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1788638434.598629:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282fff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+2:2363:x1875523174145664:12345-192.168.203.34@tcp:9:kworker.0 Request processed in 419us (1479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638434.598637:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 11 00010000:00010000:0.0:1788638434.598728:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638435.232263:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638435.557099:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788638435.557121:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183613952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788638435.557202:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638435.557264:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183613952 00000100:00100000:3.0:1788638435.557271:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183613952 00000100:00100000:3.0:1788638435.557320:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788638435.557328:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183613952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788638435.557356:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788638435.557396:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183613952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638435.557403:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1788638435.557436:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788638435.557463:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73bf61ea00 x1875523183613952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638435.557483:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183613952:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788638435.701539:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 00196f64-ae55-4ffc-b84c-468028ab3a77 00000020:00000080:2.0:1788638435.701548:0:6711:0:(genops.c:885:class_export_put()) final put ffff9c72833b9800/00196f64-ae55-4ffc-b84c-468028ab3a77 00000020:00000080:1.0:1788638435.701853:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c72833b9800/00196f64-ae55-4ffc-b84c-468028ab3a77 for lustre-OST0000 00000020:00000080:1.0:1788638435.701894:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c72833bf800 for lustre-OST0000 00010000:00010000:1.0:1788638436.256208:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638437.286315:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638437.600117:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7282ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183614208:0@lo:400:kworker.0 00000100:00100000:2.0:1788638437.600192:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638437.600304:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7282fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183614080:0@lo:400:kworker.0 00000100:00100000:3.0:1788638437.600345:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638437.600395:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183614080 00000100:00100000:3.0:1788638437.600403:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183614080 00000100:00100000:3.0:1788638437.600445:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788638437.600468:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183614080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638437.600517:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183614080:12345-0@lo:400:kworker.0 Request processed in 50us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638437.600524:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788638437.600565:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7282fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183614080:0@lo:400:kworker.0 00000100:00100000:1.0:1788638437.600732:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183614208 00000100:00100000:1.0:1788638437.600737:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183614208 00000100:00100000:1.0:1788638437.600776:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788638437.600804:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183614208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638437.606431:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7282ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183614336:0@lo:400:kworker.0 00000100:00100000:3.0:1788638437.606506:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638437.606593:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183614336 00000100:00100000:3.0:1788638437.606602:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183614336 00000100:00100000:3.0:1788638437.606653:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788638437.606662:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183614336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638437.606708:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183614336:12345-0@lo:400:kworker.0 Request processed in 48us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638437.606715:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1788638437.606735:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638437.606764:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7282ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183614336:0@lo:400:kworker.0 00000100:00100000:1.0:1788638437.610561:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183614208:12345-0@lo:400:kworker.0 Request processed in 9747us (10359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638437.610577:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788638437.618487:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7282ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183614208:0@lo:400:kworker.0 00000100:00100000:1.0:1788638437.619192:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7282ffc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183614464:0@lo:400:kworker.0 00000100:00100000:1.0:1788638437.619258:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638437.620047:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183614464 00000100:00100000:3.0:1788638437.620056:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183614464 00000100:00100000:3.0:1788638437.620125:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788638437.620134:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183614464:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788638437.620224:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788638437.622662:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7282ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183614592:0@lo:400:kworker.0 00000100:00100000:2.0:1788638437.622727:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638437.622813:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183614592 00000100:00100000:2.0:1788638437.622821:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183614592 00000100:00100000:2.0:1788638437.622878:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788638437.622887:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183614592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638437.622950:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183614592:12345-0@lo:400:kworker.0 Request processed in 64us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638437.622958:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:2.0:1788638437.622993:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638437.623037:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7282ffed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183614592:0@lo:400:kworker.0 00000100:00100000:3.0:1788638437.633175:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183614464:12345-0@lo:400:kworker.0 Request processed in 13030us (13905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638437.633192:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1788638437.633322:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7282ffc380 x1875523183614464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638437.633337:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7282ffc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183614464:0@lo:400:kworker.0 00000100:00100000:3.0:1788638437.634515:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788638437.634533:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7282ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183614720:0@lo:400:kworker.0 00000100:00100000:3.0:1788638437.634607:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638437.634688:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183614720 00000100:00100000:0.0:1788638437.634695:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183614720 00000100:00100000:0.0:1788638437.634759:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788638437.634767:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183614720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638437.634832:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183614720:12345-0@lo:400:kworker.0 Request processed in 66us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638437.634845:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:3.0:1788638437.634898:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788638437.634923:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7282ffd500 x1875523183614720/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638437.634944:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7282ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183614720:0@lo:400:kworker.0 00000100:00100000:1.0:1788638438.113414:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788638438.113437:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7282fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183614848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788638438.113505:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638438.113860:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183614848 00000100:00100000:0.0:1788638438.113868:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183614848 00000100:00100000:0.0:1788638438.113921:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788638438.113932:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183614848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788638438.113966:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638438.114030:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183614848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638438.114047:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1788638438.114124:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7282fffb80 x1875523183614848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638454 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638438.114145:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7282fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183614848:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788638438.304142:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638439.328191:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638439.686845:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638439.686902:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638439.686941:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174145792 00000100:00100000:3.0:1788638439.686952:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174145792 00000100:00100000:3.0:1788638439.687023:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 198 00000100:00100000:3.0:1788638439.687043:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+10:2364:x1875523174145792:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638439.687146:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+10:2364:x1875523174145792:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 105us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638439.687155:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 198 00000100:00100000:3.0:1788638439.687192:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174145920 00000100:00100000:3.0:1788638439.687195:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174145920 00000100:00100000:3.0:1788638439.687236:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 45 00000100:00100000:3.0:1788638439.687243:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174145920:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638439.687872:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174145920:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 624us (965us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638439.687881:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 45 00000100:00080000:3.0:1788638439.687911:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:2.0:1788638439.740570:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 00196f64-ae55-4ffc-b84c-468028ab3a77 00000020:00000080:2.0:1788638439.740586:0:7651:0:(genops.c:885:class_export_put()) final put ffff9c72833b9000/00196f64-ae55-4ffc-b84c-468028ab3a77 00000020:00000080:1.0:1788638439.741389:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c72833b9000/00196f64-ae55-4ffc-b84c-468028ab3a77 for lustre-OST0001 00000020:00000080:1.0:1788638439.741481:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c72833be800 for lustre-OST0001 00010000:00010000:0.0:1788638440.353253:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638440.672242:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788638440.672275:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183614976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788638440.672349:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638440.672662:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183614976 00000100:00100000:0.0:1788638440.672678:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183614976 00000100:00100000:0.0:1788638440.672766:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788638440.672778:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183614976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788638440.672860:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638440.672945:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183614976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638440.672954:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:0.0:1788638440.673032:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788638440.673069:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73bf61ea00 x1875523183614976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638456 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638440.673096:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183614976:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788638441.137377:0:9250:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.3 00010000:00010000:2.0:1788638441.378707:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638442.401591:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638442.720529:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183615360:0@lo:400:kworker.0 00000100:00100000:1.0:1788638442.720611:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638442.720678:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788638442.720685:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183615232:0@lo:400:kworker.0 00000100:00100000:1.0:1788638442.720708:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638442.720725:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183615744:0@lo:400:kworker.0 00000100:00100000:1.0:1788638442.720750:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638442.720806:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183615744 00000100:00100000:1.0:1788638442.720826:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183615744 00000100:00100000:1.0:1788638442.720897:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788638442.720907:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183615744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638442.720960:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183615744:12345-0@lo:400:kworker.0 Request processed in 54us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638442.720967:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1788638442.720988:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788638442.721028:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73c09a6a00 x1875523183615744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638442.721041:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183615744:0@lo:400:kworker.0 00000100:00100000:0.0:1788638442.721208:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183615104:0@lo:400:kworker.0 00000100:00100000:0.0:1788638442.721246:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638442.721278:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183615616:0@lo:400:kworker.0 00000100:00100000:0.0:1788638442.721312:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638442.721335:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788638442.721341:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183615488:0@lo:400:kworker.0 00000100:00100000:0.0:1788638442.721362:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638442.721387:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183615360 00000100:00100000:0.0:1788638442.721392:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183615360 00000100:00100000:0.0:1788638442.721424:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183615232 00000100:00100000:0.0:1788638442.721427:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183615232 00000100:00100000:0.0:1788638442.721440:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183615616 00000100:00100000:0.0:1788638442.721443:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183615616 00000100:00100000:0.0:1788638442.721458:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788638442.721464:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183615360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638442.721500:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183615360:12345-0@lo:400:kworker.0 Request processed in 36us (891us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638442.721506:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788638442.721520:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788638442.721527:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183615232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638442.721551:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183615232:12345-0@lo:400:kworker.0 Request processed in 26us (843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638442.721567:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788638442.721578:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788638442.721583:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183615616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638442.721611:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282fff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183615616:12345-0@lo:400:kworker.0 Request processed in 28us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638442.721616:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788638442.721651:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183615616:0@lo:400:kworker.0 00000100:00100000:1.0:1788638442.722611:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183615104 00000100:00100000:1.0:1788638442.722619:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183615104 00000100:00100000:1.0:1788638442.722668:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788638442.722676:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183615104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638442.722729:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183615104:12345-0@lo:400:kworker.0 Request processed in 54us (1483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638442.722736:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1788638442.722770:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183615488 00000100:00100000:1.0:1788638442.722774:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183615488 00000100:00100000:1.0:1788638442.722829:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788638442.722835:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183615488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638442.722878:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183615488:12345-0@lo:400:kworker.0 Request processed in 43us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638442.722884:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788638442.722897:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788638442.722900:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788638442.722929:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183615232:0@lo:400:kworker.0 00000100:00100000:1.0:1788638442.722956:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183615360:0@lo:400:kworker.0 00010000:00080000:0.0:1788638442.724023:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73c09a6d80 x1875523183615488/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638458 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638442.724038:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183615488:0@lo:400:kworker.0 00000100:00100000:0.0:1788638442.724051:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183615104:0@lo:400:kworker.0 00000100:00100000:2.0:1788638443.239556:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788638443.239581:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7282fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183615872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788638443.239652:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638443.240111:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183615872 00000100:00100000:0.0:1788638443.240120:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183615872 00000100:00100000:0.0:1788638443.240175:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788638443.240185:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183615872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788638443.240221:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638443.240281:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183615872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638443.240287:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788638443.240409:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7282fffb80 x1875523183615872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638459 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638443.240430:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7282fffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183615872:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788638443.423896:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788638443.620928:0:9348:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.3 00010000:00010000:2.0:1788638444.449603:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638444.808716:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638444.808814:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638444.808845:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174146048 00000100:00100000:3.0:1788638444.808854:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174146048 00000100:00100000:3.0:1788638444.808906:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 200 00000100:00100000:3.0:1788638444.808916:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+10:2364:x1875523174146048:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638444.808983:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+10:2364:x1875523174146048:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 69us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638444.809002:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 200 00000100:00100000:3.0:1788638444.809036:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174146176 00000100:00100000:3.0:1788638444.809040:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174146176 00000100:00100000:3.0:1788638444.809076:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 49 00000100:00100000:3.0:1788638444.809082:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174146176:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638444.809108:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174146176:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 27us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638444.809114:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 49 00000100:00080000:3.0:1788638444.809192:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788638445.472843:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638445.795540:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788638445.795561:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183616000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788638445.795623:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638445.795745:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183616000 00000100:00100000:1.0:1788638445.795754:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183616000 00000100:00080000:3.0:1788638445.795815:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788638445.795851:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788638445.795861:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183616000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788638445.795893:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788638445.795957:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183616000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638445.795964:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:3.0:1788638445.796034:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73bf61d880 x1875523183616000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638461 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638445.796053:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183616000:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788638446.496021:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788638446.911564:0:9446:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.3 00010000:00010000:2.0:1788638447.520077:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638447.840379:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183616512:0@lo:400:kworker.0 00000100:00100000:2.0:1788638447.840468:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638447.840527:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788638447.840533:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183616128:0@lo:400:kworker.0 00000100:00100000:2.0:1788638447.840563:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638447.840588:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183616640:0@lo:400:kworker.0 00000100:00100000:2.0:1788638447.840613:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638447.840649:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183616256:0@lo:400:kworker.0 00000100:00100000:2.0:1788638447.840675:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638447.840692:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183616768:0@lo:400:kworker.0 00000100:00100000:2.0:1788638447.840725:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638447.840745:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788638447.840751:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183616384:0@lo:400:kworker.0 00000100:00100000:2.0:1788638447.840772:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638447.840837:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183616512 00000100:00100000:2.0:1788638447.840846:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183616512 00000100:00100000:2.0:1788638447.840897:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183616768 00000100:00100000:2.0:1788638447.840900:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183616768 00000100:00100000:2.0:1788638447.840921:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788638447.840929:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183616512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638447.840993:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183616512:12345-0@lo:400:kworker.0 Request processed in 64us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638447.841001:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788638447.841017:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788638447.841023:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183616768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638447.841056:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183616768:12345-0@lo:400:kworker.0 Request processed in 33us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638447.841063:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788638447.841087:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183616128 00000100:00100000:2.0:1788638447.841091:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183616128 00000100:00100000:2.0:1788638447.841116:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788638447.841122:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183616128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638447.841150:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183616128:12345-0@lo:400:kworker.0 Request processed in 29us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638447.841166:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:2.0:1788638447.841196:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183616640 00000100:00100000:2.0:1788638447.841200:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183616640 00000100:00100000:2.0:1788638447.841227:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183616256 00000100:00100000:2.0:1788638447.841230:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183616256 00000100:00100000:2.0:1788638447.841240:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183616384 00000100:00100000:2.0:1788638447.841243:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183616384 00000100:00100000:2.0:1788638447.841257:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788638447.841263:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183616640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638447.841293:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183616640:12345-0@lo:400:kworker.0 Request processed in 30us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638447.841299:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788638447.841312:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788638447.841318:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183616256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638447.841343:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183616256:12345-0@lo:400:kworker.0 Request processed in 26us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638447.841348:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788638447.841359:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788638447.841365:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183616384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638447.841389:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183616384:12345-0@lo:400:kworker.0 Request processed in 25us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638447.841395:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1788638447.841420:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788638447.841425:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788638447.841427:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788638447.841464:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183616384:0@lo:400:kworker.0 00000100:00100000:2.0:1788638447.841492:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183616256:0@lo:400:kworker.0 00010000:00080000:2.0:1788638447.841507:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73bf61ea00 x1875523183616768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638447.841517:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183616768:0@lo:400:kworker.0 00000100:00100000:0.0:1788638447.841546:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183616128:0@lo:400:kworker.0 00000100:00100000:0.0:1788638447.841562:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183616640:0@lo:400:kworker.0 00010000:00080000:0.0:1788638447.841574:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73bf61ce00 x1875523183616512/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638463 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638447.841584:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183616512:0@lo:400:kworker.0 00000100:00100000:0.0:1788638448.352174:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638448.352205:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7282ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183616896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788638448.352304:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638448.352378:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183616896 00000100:00100000:0.0:1788638448.352402:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183616896 00000100:00100000:0.0:1788638448.352455:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788638448.352474:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183616896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788638448.352529:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638448.352955:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183616896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 488us (648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638448.352964:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788638448.353074:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7282ffd500 x1875523183616896/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638464 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638448.353098:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7282ffd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183616896:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788638448.545385:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788638448.591028:0:9494:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 16:00:47 EDT 2026 00010000:00010000:0.0:1788638449.568990:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638449.927636:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638449.927727:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638449.927811:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174146304 00000100:00100000:3.0:1788638449.927831:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174146304 00000100:00100000:3.0:1788638449.927884:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 202 00000100:00100000:3.0:1788638449.927895:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+10:2365:x1875523174146304:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638449.927984:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+10:2365:x1875523174146304:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 91us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638449.927992:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 202 00000100:00100000:2.0:1788638449.933131:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174146432 00000100:00100000:2.0:1788638449.933144:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174146432 00000100:00080000:2.0:1788638449.933464:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638449.934164:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 53 00000100:00100000:3.0:1788638449.934185:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2365:x1875523174146432:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638449.934266:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2365:x1875523174146432:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 92us (6641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638449.934273:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 53 00010000:00010000:2.0:1788638450.592179:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638450.912238:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183617024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788638450.912311:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638450.912353:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183617024 00000100:00100000:3.0:1788638450.912365:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183617024 00000100:00100000:3.0:1788638450.912422:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788638450.912432:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183617024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788638450.912466:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788638450.912508:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788638450.912514:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183617024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638450.912522:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788638450.912599:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73ad39d880 x1875523183617024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638466 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638450.912621:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183617024:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788638451.616021:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638452.640352:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638452.960186:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183617536:0@lo:400:kworker.0 00000100:00100000:0.0:1788638452.960284:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638452.960370:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788638452.960377:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183617152:0@lo:400:kworker.0 00000100:00100000:0.0:1788638452.960411:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638452.960441:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183617664:0@lo:400:kworker.0 00000100:00100000:0.0:1788638452.960469:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638452.960507:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183617152 00000100:00100000:0.0:1788638452.960516:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183617152 00000100:00100000:0.0:1788638452.960569:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788638452.960578:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183617152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638452.960636:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183617152:12345-0@lo:400:kworker.0 Request processed in 57us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638452.960660:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 203 00000100:00100000:0.0:1788638452.960701:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183617664 00000100:00100000:0.0:1788638452.960705:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183617664 00000100:00100000:0.0:1788638452.960746:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788638452.960752:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183617664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638452.960819:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282fffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183617664:12345-0@lo:400:kworker.0 Request processed in 68us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638452.960825:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1788638452.960842:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638452.960877:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183617152:0@lo:400:kworker.0 00000100:00100000:0.0:1788638452.960892:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183617664:0@lo:400:kworker.0 00000100:00100000:2.0:1788638452.961105:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183617536 00000100:00100000:2.0:1788638452.961110:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183617536 00000100:00100000:2.0:1788638452.961161:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788638452.961169:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183617536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638452.961211:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183617536:12345-0@lo:400:kworker.0 Request processed in 44us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638452.961218:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788638452.961304:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788638452.961326:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7385379f80 x1875523183617536/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638452.961339:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183617536:0@lo:400:kworker.0 00000100:00100000:3.0:1788638452.961499:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183617280:0@lo:400:kworker.0 00000100:00100000:3.0:1788638452.961534:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638452.961563:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183617792:0@lo:400:kworker.0 00000100:00100000:3.0:1788638452.961584:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638452.961607:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788638452.961613:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183617408:0@lo:400:kworker.0 00000100:00100000:3.0:1788638452.961650:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638452.961734:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183617280 00000100:00100000:1.0:1788638452.961740:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183617280 00000100:00100000:1.0:1788638452.961807:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183617408 00000100:00100000:1.0:1788638452.961810:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183617408 00000100:00100000:1.0:1788638452.961836:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788638452.961843:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183617280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638452.961884:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183617280:12345-0@lo:400:kworker.0 Request processed in 42us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638452.961891:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788638452.961903:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788638452.961909:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183617408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638452.961932:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183617408:12345-0@lo:400:kworker.0 Request processed in 24us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638452.961948:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:0.0:1788638452.962017:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638452.962116:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183617408:0@lo:400:kworker.0 00000100:00100000:3.0:1788638452.962127:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183617280:0@lo:400:kworker.0 00000100:00100000:2.0:1788638452.962329:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183617792 00000100:00100000:2.0:1788638452.962334:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183617792 00000100:00100000:2.0:1788638452.962384:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788638452.962391:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183617792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638452.962440:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183617792:12345-0@lo:400:kworker.0 Request processed in 50us (855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638452.962447:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788638452.962552:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788638452.962712:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7385379880 x1875523183617792/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638468 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638452.962724:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183617792:0@lo:400:kworker.0 00000100:00100000:1.0:1788638453.480001:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788638453.480032:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183617920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788638453.480125:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638453.480212:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183617920 00000100:00100000:1.0:1788638453.480222:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183617920 00000100:00100000:1.0:1788638453.480282:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788638453.480293:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183617920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788638453.480337:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788638453.480389:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183617920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638453.480397:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788638453.480447:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73c09a4700 x1875523183617920/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638469 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638453.480468:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183617920:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788638453.665026:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638454.689074:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638455.047985:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638455.048044:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638455.048133:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174146688 00000100:00100000:3.0:1788638455.048145:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174146688 00000100:00100000:3.0:1788638455.048225:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 57 00000100:00100000:3.0:1788638455.048235:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2367:x1875523174146688:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638455.048318:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2367:x1875523174146688:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 85us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638455.048326:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 57 00000100:00080000:1.0:1788638455.048481:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638455.058933:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174146560 00000100:00100000:0.0:1788638455.058957:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174146560 00000100:00100000:0.0:1788638455.059051:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 204 00000100:00100000:0.0:1788638455.059063:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+10:2367:x1875523174146560:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638455.059172:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+10:2367:x1875523174146560:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 109us (11124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638455.059180:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 204 00010000:00010000:2.0:1788638455.718688:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638456.036310:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788638456.036342:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183618048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788638456.036435:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638456.036532:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183618048 00000100:00100000:1.0:1788638456.036541:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183618048 00000100:00100000:1.0:1788638456.036607:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788638456.036618:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183618048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788638456.036773:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788638456.036847:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183618048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 230us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638456.036872:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788638456.038015:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788638456.038903:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c738537ad80 x1875523183618048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638472 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638456.038951:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183618048:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788638456.737101:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638457.759961:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638458.080022:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183618304:0@lo:400:kworker.0 00000100:00100000:0.0:1788638458.080088:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638458.080130:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738723ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183618816:0@lo:400:kworker.0 00000100:00100000:0.0:1788638458.080150:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638458.080180:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788638458.080266:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183618176:0@lo:400:kworker.0 00000100:00100000:2.0:1788638458.080326:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638458.080353:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183618688:0@lo:400:kworker.0 00000100:00100000:2.0:1788638458.080374:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638458.080390:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788638458.080395:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183618560:0@lo:400:kworker.0 00000100:00100000:2.0:1788638458.080429:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638458.080459:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183618176 00000100:00100000:2.0:1788638458.080465:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183618176 00000100:00100000:2.0:1788638458.080504:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788638458.080511:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183618176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638458.080552:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183618176:12345-0@lo:400:kworker.0 Request processed in 41us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638458.080559:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:2.0:1788638458.080586:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183618304 00000100:00100000:2.0:1788638458.080589:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183618304 00000100:00100000:2.0:1788638458.080610:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183618688 00000100:00100000:2.0:1788638458.080612:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183618688 00000100:00100000:2.0:1788638458.080634:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788638458.080640:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183618304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638458.080678:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183618304:12345-0@lo:400:kworker.0 Request processed in 38us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638458.080684:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788638458.080693:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788638458.080705:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183618688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638458.080727:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183618688:12345-0@lo:400:kworker.0 Request processed in 22us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638458.080732:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788638458.080747:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183618816 00000100:00100000:2.0:1788638458.080749:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183618816 00000100:00100000:2.0:1788638458.080770:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183618560 00000100:00100000:2.0:1788638458.080772:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183618560 00000100:00100000:2.0:1788638458.080799:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788638458.080805:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183618816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638458.080830:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183618816:12345-0@lo:400:kworker.0 Request processed in 26us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638458.080835:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788638458.080846:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788638458.080851:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183618560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638458.080873:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183618560:12345-0@lo:400:kworker.0 Request processed in 23us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638458.080879:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788638458.080910:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788638458.080914:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788638458.080917:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788638458.080948:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73837a4000 x1875523183618560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638458.080961:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183618560:0@lo:400:kworker.0 00000100:00100000:2.0:1788638458.080971:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4659c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183618176:0@lo:400:kworker.0 00000100:00100000:2.0:1788638458.080979:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183618688:0@lo:400:kworker.0 00000100:00100000:0.0:1788638458.081336:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183618432:0@lo:400:kworker.0 00000100:00100000:0.0:1788638458.081367:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638458.081402:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183618304:0@lo:400:kworker.0 00010000:00080000:0.0:1788638458.081552:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c738723ed80 x1875523183618816/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638474 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638458.081562:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738723ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183618816:0@lo:400:kworker.0 00000100:00100000:0.0:1788638458.081588:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183618432 00000100:00100000:0.0:1788638458.081591:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183618432 00000100:00100000:0.0:1788638458.081621:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788638458.081627:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183618432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638458.081727:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183618432:12345-0@lo:400:kworker.0 Request processed in 99us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638458.081733:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788638458.081763:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183618432:0@lo:400:kworker.0 00000100:00080000:2.0:1788638458.081922:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638458.592010:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638458.595185:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183618944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788638458.595262:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638458.595772:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183618944 00000100:00100000:1.0:1788638458.595780:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183618944 00000100:00100000:1.0:1788638458.596075:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788638458.596084:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183618944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788638458.596124:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788638458.596230:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183618944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638458.596238:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788638458.596449:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73c09a5880 x1875523183618944/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638474 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638458.596468:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183618944:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788638458.791747:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638459.808108:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638460.162622:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638460.162678:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638460.162715:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174146944 00000100:00100000:0.0:1788638460.162728:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174146944 00000100:00100000:0.0:1788638460.162823:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 61 00000100:00100000:0.0:1788638460.162834:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174146944:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638460.162934:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174146944:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 102us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638460.162943:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 61 00000100:00080000:0.0:1788638460.162964:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638460.163510:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174146816 00000100:00100000:3.0:1788638460.163517:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174146816 00000100:00100000:3.0:1788638460.163571:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 206 00000100:00100000:3.0:1788638460.163579:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+10:2364:x1875523174146816:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638460.163621:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+10:2364:x1875523174146816:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 43us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638460.163629:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 206 00010000:00010000:2.0:1788638460.834453:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638461.156219:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788638461.156250:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738723c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183619072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788638461.156349:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638461.156432:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183619072 00000100:00100000:0.0:1788638461.156441:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183619072 00000100:00100000:0.0:1788638461.156512:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788638461.156523:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183619072:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788638461.157911:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788638461.158097:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638461.158198:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183619072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1674us (1846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638461.158210:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1788638461.158278:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c738723c000 x1875523183619072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638477 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638461.158326:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738723c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183619072:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788638461.860469:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638462.891924:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638463.201848:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183619328:0@lo:400:kworker.0 00000100:00100000:1.0:1788638463.201926:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638463.201976:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183619840:0@lo:400:kworker.0 00000100:00100000:2.0:1788638463.202098:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183619200:0@lo:400:kworker.0 00000100:00100000:2.0:1788638463.202135:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638463.202162:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183619712:0@lo:400:kworker.0 00000100:00100000:2.0:1788638463.202184:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638463.202211:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788638463.202217:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183619584:0@lo:400:kworker.0 00000100:00100000:2.0:1788638463.202250:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183619200 00000100:00100000:2.0:1788638463.202257:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183619200 00000100:00100000:2.0:1788638463.202302:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788638463.202311:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183619200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638463.202362:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183619200:12345-0@lo:400:kworker.0 Request processed in 52us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638463.202369:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:2.0:1788638463.202401:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183619328 00000100:00100000:2.0:1788638463.202405:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183619328 00000100:00100000:2.0:1788638463.202430:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183619712 00000100:00100000:2.0:1788638463.202433:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183619712 00000100:00100000:2.0:1788638463.202463:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788638463.202470:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183619328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638463.202501:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f25880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183619328:12345-0@lo:400:kworker.0 Request processed in 32us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638463.202507:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788638463.202519:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788638463.202533:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183619712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638463.202561:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183619712:12345-0@lo:400:kworker.0 Request processed in 30us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638463.202567:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1788638463.202592:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788638463.202692:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638463.202808:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183619328:0@lo:400:kworker.0 00000100:00100000:1.0:1788638463.202822:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788638463.202828:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183619456:0@lo:400:kworker.0 00000100:00100000:1.0:1788638463.202854:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638463.202898:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183619456 00000100:00100000:1.0:1788638463.202902:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183619456 00000100:00100000:1.0:1788638463.202933:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788638463.202940:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183619456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638463.202974:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f24a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183619456:12345-0@lo:400:kworker.0 Request processed in 34us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638463.202987:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1788638463.203068:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788638463.203094:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183619456:0@lo:400:kworker.0 00000100:00100000:3.0:1788638463.203309:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638463.204134:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183619200:0@lo:400:kworker.0 00000100:00100000:3.0:1788638463.204149:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f24000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183619712:0@lo:400:kworker.0 00000100:00100000:2.0:1788638463.204214:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183619840 00000100:00100000:2.0:1788638463.204220:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183619840 00000100:00100000:2.0:1788638463.204273:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183619584 00000100:00100000:2.0:1788638463.204276:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183619584 00000100:00100000:2.0:1788638463.204293:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788638463.204299:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183619840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638463.204353:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183619840:12345-0@lo:400:kworker.0 Request processed in 54us (2348us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638463.204360:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788638463.204372:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788638463.204378:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183619584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638463.204407:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183619584:12345-0@lo:400:kworker.0 Request processed in 30us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638463.204413:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788638463.204440:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b4f27480 x1875523183619584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638463.204450:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f27480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183619584:0@lo:400:kworker.0 00000100:00080000:3.0:1788638463.204624:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788638463.204629:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788638463.204749:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b4f26680 x1875523183619840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638479 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638463.204759:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183619840:0@lo:400:kworker.0 00000100:00100000:2.0:1788638463.714680:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183619968:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788638463.714755:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638463.714989:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183619968 00000100:00100000:0.0:1788638463.714996:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183619968 00000100:00100000:0.0:1788638463.715078:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788638463.715090:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183619968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788638463.715129:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638463.715192:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183619968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638463.715200:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1788638463.715568:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b4f26680 x1875523183619968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638479 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638463.715605:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f26680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183619968:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788638463.907032:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638464.929181:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638465.287168:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638465.287216:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638465.287321:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174147200 00000100:00100000:2.0:1788638465.287330:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174147200 00000100:00100000:3.0:1788638465.287395:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174147072 00000100:00100000:3.0:1788638465.287400:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174147072 00000100:00100000:2.0:1788638465.287413:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 65 00000100:00100000:2.0:1788638465.287427:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2367:x1875523174147200:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638465.287439:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 208 00000100:00100000:3.0:1788638465.287453:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+10:2367:x1875523174147072:12345-192.168.203.34@tcp:400:kworker.0 00000100:00080000:0.0:1788638465.287480:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638465.287500:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2367:x1875523174147200:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 75us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638465.287501:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+10:2367:x1875523174147072:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 52us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638465.287516:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 65 00000100:00100000:3.0:1788638465.287524:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 208 00000001:02000400:1.0:1788638465.597462:0:10137:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 16:01:04 (1788638464) === 00010000:00010000:1.0:1788638465.952878:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638466.202010:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638466.202182:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174147328 00000100:00100000:2.0:1788638466.202192:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174147328 00000100:00100000:2.0:1788638466.202290:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 209 00000100:00100000:2.0:1788638466.202300:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+10:8147:x1875523174147328:12345-192.168.203.34@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788638466.202317:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638466.202337:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7399aa6200/0xa0b1f1e3b4b2a8a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434d3c expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638466.202366:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7399aa6200/0xa0b1f1e3b4b2a8a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d3c expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638466.202378:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7399aa6200/0xa0b1f1e3b4b2a8a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d3c expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638466.202388:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6200, rc 0) 00000100:00100000:2.0:1788638466.202445:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+11:8147:x1875523174147328:12345-192.168.203.34@tcp:101:mount.lustre.0 Request processed in 147us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638466.202465:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 209 00000100:00100000:0.0:1788638466.227187:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638466.227271:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174147456 00000100:00100000:3.0:1788638466.227282:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174147456 00000100:00100000:0.0:1788638466.227446:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 210 00000100:00100000:0.0:1788638466.227458:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+11:8147:x1875523174147456:12345-192.168.203.34@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788638466.227754:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+11:8147:x1875523174147456:12345-192.168.203.34@tcp:501:mount.lustre.0 Request processed in 297us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638466.227762:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 210 00000100:00100000:0.0:1788638466.246759:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638466.248135:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174147584 00000100:00100000:2.0:1788638466.248147:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174147584 00000100:00100000:2.0:1788638466.248224:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 211 00000100:00100000:2.0:1788638466.248236:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+11:8147:x1875523174147584:12345-192.168.203.34@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788638466.248531:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+11:8147:x1875523174147584:12345-192.168.203.34@tcp:503:mount.lustre.0 Request processed in 297us (1780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638466.248540:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 211 00000100:00100000:1.0:1788638466.261251:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638466.261518:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174147712 00000100:00100000:0.0:1788638466.261528:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174147712 00000100:00100000:0.0:1788638466.261586:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 212 00000100:00100000:0.0:1788638466.261595:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+11:8151:x1875523174147712:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788638466.261922:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+11:8151:x1875523174147712:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 326us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638466.261934:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 212 00000100:00100000:2.0:1788638466.272702:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788638466.272728:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738723e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183620096:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788638466.272829:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638466.273082:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183620096 00000100:00100000:0.0:1788638466.273092:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183620096 00000100:00100000:0.0:1788638466.273163:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788638466.273173:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183620096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788638466.273209:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638466.273259:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183620096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638466.273266:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1788638466.273774:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c738723e680 x1875523183620096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638482 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638466.273816:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738723e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183620096:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788638466.274173:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788638466.289724:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638466.289942:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174147840 00000100:00100000:3.0:1788638466.289952:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174147840 00000100:00100000:3.0:1788638466.290589:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 213 00000100:00100000:3.0:1788638466.290602:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+11:8151:x1875523174147840:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788638466.291923:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+11:8151:x1875523174147840:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 1317us (2201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638466.291936:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 213 00000100:00100000:1.0:1788638466.305088:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638466.305247:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174147968 00000100:00100000:0.0:1788638466.305258:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174147968 00000100:00100000:0.0:1788638466.305319:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 214 00000100:00100000:0.0:1788638466.305329:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+11:8147:x1875523174147968:12345-192.168.203.34@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788638466.305346:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638466.305365:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73813fc200/0xa0b1f1e3b4b2a8ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434d66 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638466.305394:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73813fc200/0xa0b1f1e3b4b2a8ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d66 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638466.305405:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73813fc200/0xa0b1f1e3b4b2a8ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d66 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638466.305414:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73813fc200, rc 0) 00000100:00100000:0.0:1788638466.305505:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+12:8147:x1875523174147968:12345-192.168.203.34@tcp:101:mount.lustre.0 Request processed in 176us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638466.305513:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 214 00000100:00100000:1.0:1788638466.309466:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638466.309547:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174148096 00000100:00100000:3.0:1788638466.309557:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174148096 00000100:00100000:3.0:1788638466.309613:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 215 00000100:00100000:3.0:1788638466.309623:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+12:8147:x1875523174148096:12345-192.168.203.34@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788638466.309649:0:5835:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788638466.309674:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788638466.309678:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788638466.309680:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788638466.309683:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788638466.313527:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+12:8147:x1875523174148096:12345-192.168.203.34@tcp:256:mount.lustre.0 Request processed in 3894us (4059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638466.313544:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 215 00000100:00100000:1.0:1788638466.316581:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638466.316667:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174148224 00000100:00100000:2.0:1788638466.316677:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174148224 00000100:00100000:2.0:1788638466.316729:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 216 00000100:00100000:2.0:1788638466.316738:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+12:8147:x1875523174148224:12345-192.168.203.34@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788638466.316753:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638466.316771:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a8b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434d6d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638466.316830:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a8b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d6d expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638466.316865:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a8b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d6d expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638466.316874:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6400, rc 0) 00000100:00100000:2.0:1788638466.316926:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:8147:x1875523174148224:12345-192.168.203.34@tcp:101:mount.lustre.0 Request processed in 189us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638466.316933:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 216 00000100:00100000:1.0:1788638466.320162:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638466.320426:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174148352 00000100:00100000:3.0:1788638466.320437:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174148352 00000100:00100000:3.0:1788638466.320497:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 217 00000100:00100000:3.0:1788638466.320506:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+13:8147:x1875523174148352:12345-192.168.203.34@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788638466.320859:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+13:8147:x1875523174148352:12345-192.168.203.34@tcp:501:mount.lustre.0 Request processed in 352us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638466.320868:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 217 00000100:00100000:1.0:1788638466.327029:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638466.327114:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174148480 00000100:00100000:0.0:1788638466.327124:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174148480 00000100:00100000:0.0:1788638466.327175:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 218 00000100:00100000:0.0:1788638466.327185:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+13:8147:x1875523174148480:12345-192.168.203.34@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788638466.327412:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+13:8147:x1875523174148480:12345-192.168.203.34@tcp:503:mount.lustre.0 Request processed in 227us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638466.327420:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 218 00000100:00100000:1.0:1788638466.333067:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638466.333225:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174148608 00000100:00100000:2.0:1788638466.333235:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174148608 00000100:00100000:2.0:1788638466.333291:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 219 00000100:00100000:2.0:1788638466.333302:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:8156:x1875523174148608:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788638466.333561:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:8156:x1875523174148608:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 260us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638466.333569:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 219 00000100:00100000:1.0:1788638466.339212:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638466.339348:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174148736 00000100:00100000:3.0:1788638466.339358:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174148736 00000100:00100000:3.0:1788638466.339413:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 220 00000100:00100000:3.0:1788638466.339431:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+13:8156:x1875523174148736:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788638466.339929:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+13:8156:x1875523174148736:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 505us (724us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638466.339938:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 220 00000100:00100000:1.0:1788638466.354169:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638466.354278:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174148864 00000100:00100000:2.0:1788638466.354288:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174148864 00000100:00100000:2.0:1788638466.354336:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:2.0:1788638466.354345:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2363:x1875523174148864:12345-192.168.203.34@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788638466.354376:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from cdbf9a9f-afb3-447e-b3b7-3039526706d5@192.168.203.34@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:2.0:1788638466.354415:0:5843:0:(genops.c:1385:class_connect()) connect: client cdbf9a9f-afb3-447e-b3b7-3039526706d5, cookie 0xa0b1f1e3b4b2a8bb 00000004:00100000:2.0:1788638466.354462:0:5843:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:2.0:1788638466.354718:0:5843:0:(import.c:65:import_set_state_nolock()) ffff9c73bf2d0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788638466.357180:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f25180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdbf9a9f-afb3-447e-b3b7-3039526706d5+6:2363:x1875523174148864:12345-192.168.203.34@tcp:38:mount.lustre.0 Request processed in 2821us (3006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638466.357215:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:1.0:1788638466.372138:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638466.372234:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638466.377184:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174148992 00000100:00100000:2.0:1788638466.377201:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174148992 00000100:00100000:1.0:1788638466.377262:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638466.378603:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174149248 00000100:00100000:3.0:1788638466.378615:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174149248 00000100:00100000:3.0:1788638466.378666:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174149120 00000100:00100000:3.0:1788638466.378669:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174149120 00000100:00100000:3.0:1788638466.378689:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 66 00000100:00100000:3.0:1788638466.378699:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174148992:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638466.378793:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f27b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174148992:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 83us (6652us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638466.378810:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 66 00000100:00100000:3.0:1788638466.378854:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 11 00000100:00100000:3.0:1788638466.378862:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdbf9a9f-afb3-447e-b3b7-3039526706d5+7:8147:x1875523174149248:12345-192.168.203.34@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788638466.378897:0:7634:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788638466.379163:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f25500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdbf9a9f-afb3-447e-b3b7-3039526706d5+7:8147:x1875523174149248:12345-192.168.203.34@tcp:41:mount.lustre.0 Request processed in 301us (6927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638466.379171:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 11 00000100:00100000:3.0:1788638466.379186:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00100000:3.0:1788638466.379193:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdbf9a9f-afb3-447e-b3b7-3039526706d5+6:0:x1875523174149120:12345-192.168.203.34@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788638466.379204:0:7634:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788638466.379225:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f27100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdbf9a9f-afb3-447e-b3b7-3039526706d5+6:0:x1875523174149120:12345-192.168.203.34@tcp:41:mount.lustre.0 Request processed in 33us (1981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638466.379230:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00080000:0.0:1788638466.382344:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638466.385330:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638466.385409:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174149376 00000100:00100000:3.0:1788638466.385432:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174149376 00000100:00100000:3.0:1788638466.385494:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:3.0:1788638466.385504:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdbf9a9f-afb3-447e-b3b7-3039526706d5+6:8147:x1875523174149376:12345-192.168.203.34@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788638466.385593:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdbf9a9f-afb3-447e-b3b7-3039526706d5+6:8147:x1875523174149376:12345-192.168.203.34@tcp:40:mount.lustre.0 Request processed in 90us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638466.385601:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:0.0:1788638466.389394:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638466.389444:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638466.389519:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174149504 00000100:00100000:3.0:1788638466.389528:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174149504 00000100:00100000:3.0:1788638466.389565:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174149632 00000100:00100000:3.0:1788638466.389568:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174149632 00000100:00100000:3.0:1788638466.389582:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00100000:3.0:1788638466.389590:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2363:x1875523174149504:12345-192.168.203.34@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788638466.389635:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from cdbf9a9f-afb3-447e-b3b7-3039526706d5@192.168.203.34@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:3.0:1788638466.389665:0:6687:0:(genops.c:1385:class_connect()) connect: client cdbf9a9f-afb3-447e-b3b7-3039526706d5, cookie 0xa0b1f1e3b4b2a8c2 00002000:00100000:3.0:1788638466.389676:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli cdbf9a9f-afb3-447e-b3b7-3039526706d5/ffff9c73ad653000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788638466.389686:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:3.0:1788638466.389941:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788638466.390082:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9c73ad651800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788638466.390151:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdbf9a9f-afb3-447e-b3b7-3039526706d5+6:2363:x1875523174149504:12345-192.168.203.34@tcp:8:mount.lustre.0 Request processed in 561us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638466.390159:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00100000:3.0:1788638466.390179:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:3.0:1788638466.390185:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2363:x1875523174149632:12345-192.168.203.34@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788638466.390200:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from cdbf9a9f-afb3-447e-b3b7-3039526706d5@192.168.203.34@tcp t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:3.0:1788638466.390215:0:6687:0:(genops.c:1385:class_connect()) connect: client cdbf9a9f-afb3-447e-b3b7-3039526706d5, cookie 0xa0b1f1e3b4b2a8c9 00002000:00100000:3.0:1788638466.390220:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli cdbf9a9f-afb3-447e-b3b7-3039526706d5/ffff9c73ad655800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788638466.390237:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:3.0:1788638466.390357:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788638466.390373:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9c7398785000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788638466.390397:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdbf9a9f-afb3-447e-b3b7-3039526706d5+6:2363:x1875523174149632:12345-192.168.203.34@tcp:8:mount.lustre.0 Request processed in 211us (952us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638466.390403:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:0.0:1788638466.393212:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638466.393301:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174149760 00000100:00100000:3.0:1788638466.393311:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174149760 00000100:00100000:3.0:1788638466.393366:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 1 00000100:00100000:3.0:1788638466.393375:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdbf9a9f-afb3-447e-b3b7-3039526706d5+6:8147:x1875523174149760:12345-192.168.203.34@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788638466.393489:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788638466.393579:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:cdbf9a9f-afb3-447e-b3b7-3039526706d5+6:8147:x1875523174149760:12345-192.168.203.34@tcp:33:mount.lustre.0 Request processed in 204us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638466.393587:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 1 00010000:00010000:2.0:1788638466.978008:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638468.001484:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638468.320247:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183620352:0@lo:400:kworker.0 00000100:00100000:2.0:1788638468.320313:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638468.320366:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183620864:0@lo:400:kworker.0 00000100:00100000:2.0:1788638468.320395:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638468.320599:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788638468.320734:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183620480:0@lo:400:kworker.0 00000100:00100000:2.0:1788638468.320762:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638468.320839:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183620352 00000100:00100000:2.0:1788638468.320846:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183620352 00000100:00100000:2.0:1788638468.320889:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183620480 00000100:00100000:2.0:1788638468.320892:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183620480 00000100:00100000:2.0:1788638468.320920:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788638468.320928:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183620352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638468.320979:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183620352:12345-0@lo:400:kworker.0 Request processed in 52us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638468.320987:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788638468.321003:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788638468.321009:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183620480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638468.321034:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4659c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183620480:12345-0@lo:400:kworker.0 Request processed in 26us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638468.321041:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788638468.321062:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183620864 00000100:00100000:2.0:1788638468.321072:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183620864 00000100:00100000:2.0:1788638468.321112:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788638468.321120:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183620864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638468.321151:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183620864:12345-0@lo:400:kworker.0 Request processed in 33us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638468.321158:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788638468.321201:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183620480:0@lo:400:kworker.0 00000100:00100000:2.0:1788638468.321214:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183620352:0@lo:400:kworker.0 00010000:00080000:2.0:1788638468.321226:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7385379f80 x1875523183620864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638468.321236:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183620864:0@lo:400:kworker.0 00000100:00100000:0.0:1788638468.321322:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183620224:0@lo:400:kworker.0 00000100:00100000:0.0:1788638468.321364:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638468.321397:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183620736:0@lo:400:kworker.0 00000100:00100000:0.0:1788638468.321431:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638468.321451:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788638468.321458:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183620608:0@lo:400:kworker.0 00000100:00100000:0.0:1788638468.321481:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788638468.321507:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788638468.321512:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638468.321524:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183620608 00000100:00100000:0.0:1788638468.321528:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183620608 00000100:00100000:0.0:1788638468.321716:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788638468.321724:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183620608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638468.321768:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183620608:12345-0@lo:400:kworker.0 Request processed in 46us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638468.321776:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788638468.321822:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788638468.321853:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7385378700 x1875523183620608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638484 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638468.321864:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183620608:0@lo:400:kworker.0 00000100:00100000:0.0:1788638468.321883:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183620736 00000100:00100000:0.0:1788638468.321887:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183620736 00000100:00100000:0.0:1788638468.321917:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788638468.321924:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183620736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638468.321959:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183620736:12345-0@lo:400:kworker.0 Request processed in 36us (528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638468.321965:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1788638468.321977:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638468.321993:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183620736:0@lo:400:kworker.0 00000100:00100000:2.0:1788638468.322159:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183620224 00000100:00100000:2.0:1788638468.322163:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183620224 00000100:00100000:2.0:1788638468.322234:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788638468.322241:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183620224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638468.322292:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183620224:12345-0@lo:400:kworker.0 Request processed in 52us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638468.322298:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788638468.322352:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183620224:0@lo:400:kworker.0 00000100:00100000:1.0:1788638468.833842:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788638468.833870:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183620992:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788638468.833949:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638468.834036:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183620992 00000100:00100000:1.0:1788638468.834044:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183620992 00000100:00100000:1.0:1788638468.834094:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788638468.834104:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183620992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788638468.834141:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788638468.834189:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f26680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183620992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638468.834196:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788638468.834240:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b4f26d80 x1875523183620992/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638484 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638468.834259:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183620992:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788638469.025363:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788638469.899594:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cdbf9a9f-afb3-447e-b3b7-3039526706d5 00010000:00010000:2.0:1788638470.048021:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788638470.416369:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cdbf9a9f-afb3-447e-b3b7-3039526706d5 00010000:00010000:0.0:1788638471.082182:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638471.393891:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183621120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788638471.393979:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638471.394233:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183621120 00000100:00100000:2.0:1788638471.394245:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183621120 00000100:00080000:2.0:1788638471.394418:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788638471.394482:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788638471.394493:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183621120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788638471.394536:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788638471.395546:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183621120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1050us (1563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638471.395628:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1788638471.395681:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7385379180 x1875523183621120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638487 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638471.395706:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183621120:0@lo:13:osp-pre-0-0.0 00000001:00100000:0.0:1788638471.425747:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cdbf9a9f-afb3-447e-b3b7-3039526706d5 00000100:00100000:0.0:1788638471.428668:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638471.428703:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638471.428749:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638471.428769:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638471.428917:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174150272 00000100:00100000:0.0:1788638471.428919:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638471.428927:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174150272 00000100:00100000:0.0:1788638471.428940:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174149888 00000100:00100000:0.0:1788638471.428975:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174149888 00000100:00100000:3.0:1788638471.428978:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174150400 00000100:00100000:3.0:1788638471.428981:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174150400 00000100:00100000:3.0:1788638471.428997:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 39 00000100:00100000:0.0:1788638471.429001:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 222 00000100:00100000:3.0:1788638471.429006:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2364:x1875523174150272:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638471.429027:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+13:2364:x1875523174149888:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638471.429074:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2364:x1875523174150272:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 69us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638471.429081:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 39 00000100:00100000:3.0:1788638471.429097:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 40 00000100:00100000:3.0:1788638471.429104:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2364:x1875523174150400:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638471.429147:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174150016 00000100:00100000:2.0:1788638471.429151:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174150016 00000100:00100000:2.0:1788638471.429184:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174150144 00000100:00100000:2.0:1788638471.429187:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174150144 00000100:00100000:2.0:1788638471.429208:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 70 00000100:00100000:1.0:1788638471.429213:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 71 00000100:00100000:2.0:1788638471.429214:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174150016:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638471.429221:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2364:x1875523174150144:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638471.429587:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+13:2364:x1875523174149888:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 577us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638471.429588:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2364:x1875523174150400:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 485us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638471.429596:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 40 00000100:00100000:0.0:1788638471.429596:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 222 00000100:00100000:2.0:1788638471.429644:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174150016:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 430us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638471.429651:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 70 00000100:00080000:2.0:1788638471.429669:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788638471.429674:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788638471.429676:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788638471.429734:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2364:x1875523174150144:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 513us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638471.429742:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 71 00000001:02000400:0.0:1788638471.676279:0:10335:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg334-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1788638472.097384:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638473.122295:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638473.440073:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788638473.440094:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183621376:0@lo:400:kworker.0 00000100:00100000:2.0:1788638473.440159:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638473.440238:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183621504:0@lo:400:kworker.0 00000100:00100000:2.0:1788638473.440261:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638473.440296:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183621376 00000100:00100000:2.0:1788638473.440302:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183621376 00000100:00100000:2.0:1788638473.440355:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183621504 00000100:00100000:2.0:1788638473.440358:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183621504 00000100:00100000:2.0:1788638473.440382:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788638473.440389:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183621376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638473.440433:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183621376:12345-0@lo:400:kworker.0 Request processed in 44us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638473.440439:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788638473.440453:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788638473.440459:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183621504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638473.440481:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183621504:12345-0@lo:400:kworker.0 Request processed in 23us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638473.440504:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1788638473.440525:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638473.440553:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183621504:0@lo:400:kworker.0 00000100:00100000:2.0:1788638473.440565:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183621376:0@lo:400:kworker.0 00000100:00100000:2.0:1788638473.440613:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788638473.440619:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183621888:0@lo:400:kworker.0 00000100:00100000:2.0:1788638473.440645:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638473.440899:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183621632:0@lo:400:kworker.0 00000100:00100000:0.0:1788638473.440933:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638473.440966:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788638473.440971:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183621248:0@lo:400:kworker.0 00000100:00100000:0.0:1788638473.441007:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638473.441031:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183621760:0@lo:400:kworker.0 00000100:00100000:0.0:1788638473.441051:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638473.441075:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183621760 00000100:00100000:0.0:1788638473.441079:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183621760 00000100:00100000:0.0:1788638473.441110:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788638473.441116:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183621760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638473.441147:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183621760:12345-0@lo:400:kworker.0 Request processed in 31us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638473.441152:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788638473.441168:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183621248 00000100:00100000:0.0:1788638473.441171:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183621248 00000100:00100000:0.0:1788638473.441191:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788638473.441196:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183621248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638473.441227:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183621248:12345-0@lo:400:kworker.0 Request processed in 30us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638473.441240:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:0.0:1788638473.441264:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638473.441278:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183621248:0@lo:400:kworker.0 00000100:00100000:0.0:1788638473.441288:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183621760:0@lo:400:kworker.0 00000100:00100000:2.0:1788638473.441540:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183621888 00000100:00100000:2.0:1788638473.441545:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183621888 00000100:00100000:2.0:1788638473.441584:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183621632 00000100:00100000:2.0:1788638473.441587:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183621632 00000100:00100000:2.0:1788638473.441601:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788638473.441617:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183621888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638473.441655:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183621888:12345-0@lo:400:kworker.0 Request processed in 48us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638473.441662:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788638473.441680:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788638473.441686:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bba59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183621632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638473.441717:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bba59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183621632:12345-0@lo:400:kworker.0 Request processed in 30us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638473.441722:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1788638473.441919:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73837a5180 x1875523183621888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638473.441929:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183621888:0@lo:400:kworker.0 00000100:00080000:0.0:1788638473.442622:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788638473.442627:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788638473.442652:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7385378700 x1875523183621632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638489 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638473.442663:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183621632:0@lo:400:kworker.0 00000100:00100000:0.0:1788638473.954908:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638473.954932:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183622016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788638473.955011:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638473.955437:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183622016 00000100:00100000:1.0:1788638473.955444:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183622016 00000100:00100000:1.0:1788638473.955495:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788638473.955506:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183622016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788638473.955542:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788638473.955599:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183622016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638473.955619:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788638473.955704:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b4f26d80 x1875523183622016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638489 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638473.955723:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f26d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183622016:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788638474.156029:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638475.171913:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638476.192088:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638476.513448:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183622144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788638476.513526:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638476.513749:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183622144 00000100:00100000:2.0:1788638476.513756:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183622144 00000100:00100000:2.0:1788638476.513884:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788638476.513895:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183622144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788638476.513939:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788638476.514012:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183622144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638476.514019:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1788638476.514062:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73837a5180 x1875523183622144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638492 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638476.514079:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183622144:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788638476.514864:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788638476.546866:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638476.546913:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638476.546936:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638476.546975:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638476.547006:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638476.547050:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174150784 00000100:00100000:0.0:1788638476.547061:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174150784 00000100:00100000:0.0:1788638476.547118:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174150656 00000100:00100000:0.0:1788638476.547122:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174150656 00000100:00100000:0.0:1788638476.547145:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 75 00000100:00100000:0.0:1788638476.547155:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2367:x1875523174150784:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638476.547237:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2367:x1875523174150784:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 83us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638476.547245:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 75 00000100:00100000:0.0:1788638476.547262:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 76 00000100:00100000:0.0:1788638476.547268:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2367:x1875523174150656:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638476.547291:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2367:x1875523174150656:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 23us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638476.547297:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 76 00000100:00100000:0.0:1788638476.547314:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174151040 00000100:00100000:0.0:1788638476.547318:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174151040 00000100:00100000:0.0:1788638476.547341:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174150912 00000100:00100000:0.0:1788638476.547343:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174150912 00000100:00100000:0.0:1788638476.547358:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 43 00000100:00100000:0.0:1788638476.547364:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2367:x1875523174151040:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638476.547389:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2367:x1875523174151040:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 25us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638476.547395:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 43 00000100:00100000:0.0:1788638476.547407:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 44 00000100:00100000:0.0:1788638476.547413:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2367:x1875523174150912:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638476.547433:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2367:x1875523174150912:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 22us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638476.547446:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 44 00000100:00080000:0.0:1788638476.547590:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788638476.547594:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788638476.547597:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638476.547810:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174150528 00000100:00100000:2.0:1788638476.547816:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174150528 00000100:00100000:2.0:1788638476.547854:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 224 00000100:00100000:2.0:1788638476.547862:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:2367:x1875523174150528:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638476.547904:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:2367:x1875523174150528:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 42us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638476.547918:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 224 00010000:00010000:0.0:1788638477.215880:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638478.240253:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638478.561834:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183622272:0@lo:400:kworker.0 00000100:00100000:3.0:1788638478.561911:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638478.561956:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183622784:0@lo:400:kworker.0 00000100:00100000:3.0:1788638478.561982:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638478.562026:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788638478.562053:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183622656:0@lo:400:kworker.0 00000100:00100000:3.0:1788638478.562082:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638478.562115:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183622784 00000100:00100000:3.0:1788638478.562122:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183622784 00000100:00100000:3.0:1788638478.562179:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788638478.562188:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183622784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638478.562240:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183622784:12345-0@lo:400:kworker.0 Request processed in 53us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638478.562248:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788638478.562271:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183622656 00000100:00100000:3.0:1788638478.562274:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183622656 00000100:00100000:3.0:1788638478.562298:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788638478.562305:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183622656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638478.562333:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183622656:12345-0@lo:400:kworker.0 Request processed in 29us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638478.562339:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1788638478.562352:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788638478.562357:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788638478.562384:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c738537b100 x1875523183622656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638478.562398:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183622656:0@lo:400:kworker.0 00000100:00100000:3.0:1788638478.562409:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183622784:0@lo:400:kworker.0 00000100:00100000:1.0:1788638478.562487:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183622400:0@lo:400:kworker.0 00000100:00100000:1.0:1788638478.562516:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638478.562543:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183622912:0@lo:400:kworker.0 00000100:00100000:1.0:1788638478.562564:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638478.562580:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788638478.562585:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183622528:0@lo:400:kworker.0 00000100:00100000:1.0:1788638478.562605:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638478.562630:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183622400 00000100:00100000:1.0:1788638478.562635:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183622400 00000100:00100000:1.0:1788638478.562654:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183622528 00000100:00100000:1.0:1788638478.562657:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183622528 00000100:00100000:1.0:1788638478.562676:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788638478.562680:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183622400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638478.562713:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f27480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183622400:12345-0@lo:400:kworker.0 Request processed in 32us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638478.562718:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788638478.562730:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788638478.562735:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183622528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638478.562770:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f26d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183622528:12345-0@lo:400:kworker.0 Request processed in 25us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638478.562776:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788638478.562828:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183622528:0@lo:400:kworker.0 00000100:00100000:1.0:1788638478.562852:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183622400:0@lo:400:kworker.0 00000100:00100000:3.0:1788638478.562998:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183622912 00000100:00100000:3.0:1788638478.563002:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183622912 00000100:00100000:3.0:1788638478.563041:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788638478.563048:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183622912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638478.563093:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f24000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183622912:12345-0@lo:400:kworker.0 Request processed in 45us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638478.563099:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1788638478.563114:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788638478.563117:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788638478.563133:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c738537ad80 x1875523183622912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638494 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638478.563143:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183622912:0@lo:400:kworker.0 00000100:00100000:0.0:1788638478.563489:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183622272 00000100:00100000:0.0:1788638478.563494:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183622272 00000100:00100000:0.0:1788638478.563533:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788638478.563542:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183622272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638478.563594:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183622272:12345-0@lo:400:kworker.0 Request processed in 54us (1682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638478.563601:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788638478.572817:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183622272:0@lo:400:kworker.0 00000100:00100000:1.0:1788638479.078869:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183623040:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788638479.078947:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638479.079687:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183623040 00000100:00100000:2.0:1788638479.079696:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183623040 00000100:00100000:2.0:1788638479.079746:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788638479.079768:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183623040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788638479.080991:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788638479.081077:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f27800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183623040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1320us (2128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638479.081085:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788638479.081156:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b4f24380 x1875523183623040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638495 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638479.081177:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183623040:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788638479.272319:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638480.287982:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638481.314019:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638481.633035:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788638481.633058:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183623168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788638481.633130:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638481.633194:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183623168 00000100:00100000:0.0:1788638481.633201:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183623168 00000100:00100000:0.0:1788638481.633259:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788638481.633268:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183623168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788638481.633300:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638481.633344:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183623168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638481.633351:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788638481.633372:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788638481.633399:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7385379180 x1875523183623168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638497 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638481.633435:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183623168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788638481.666278:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638481.666334:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638481.666369:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638481.666393:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638481.666420:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638481.666450:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174151680 00000100:00100000:0.0:1788638481.666459:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174151680 00000100:00100000:0.0:1788638481.666527:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174151552 00000100:00100000:0.0:1788638481.666530:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174151552 00000100:00100000:0.0:1788638481.666550:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 47 00000100:00100000:0.0:1788638481.666560:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2366:x1875523174151680:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638481.666625:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2366:x1875523174151680:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 67us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638481.666633:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 47 00000100:00100000:0.0:1788638481.666652:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 48 00000100:00100000:0.0:1788638481.666660:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2366:x1875523174151552:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638481.666662:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174151168 00000100:00100000:1.0:1788638481.666668:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174151168 00000100:00100000:0.0:1788638481.666686:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2366:x1875523174151552:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 28us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638481.666694:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 48 00000100:00100000:1.0:1788638481.666710:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 226 00000100:00100000:1.0:1788638481.666720:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+13:2366:x1875523174151168:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638481.666726:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174151424 00000100:00100000:0.0:1788638481.666731:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174151424 00000100:00100000:1.0:1788638481.666769:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+13:2366:x1875523174151168:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 49us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638481.666774:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174151296 00000100:00100000:1.0:1788638481.666778:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 226 00000100:00100000:0.0:1788638481.666779:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174151296 00000100:00100000:0.0:1788638481.666830:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 80 00000100:00100000:0.0:1788638481.666838:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2366:x1875523174151424:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638481.666890:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2366:x1875523174151424:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 53us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638481.666897:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 80 00000100:00100000:0.0:1788638481.666911:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 81 00000100:00100000:0.0:1788638481.666917:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2366:x1875523174151296:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638481.666939:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2366:x1875523174151296:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 23us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638481.666944:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 81 00000100:00080000:0.0:1788638481.666963:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788638481.666968:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788638481.666970:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788638482.340258:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638483.364191:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638483.687875:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183623680:0@lo:400:kworker.0 00000100:00100000:2.0:1788638483.687948:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638483.688020:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788638483.688027:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183623296:0@lo:400:kworker.0 00000100:00100000:2.0:1788638483.688059:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638483.688085:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183623808:0@lo:400:kworker.0 00000100:00100000:2.0:1788638483.688107:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638483.688128:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183623424:0@lo:400:kworker.0 00000100:00100000:2.0:1788638483.688148:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638483.688164:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183623936:0@lo:400:kworker.0 00000100:00100000:2.0:1788638483.688180:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638483.688210:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788638483.688215:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183623552:0@lo:400:kworker.0 00000100:00100000:2.0:1788638483.688236:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638483.688266:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183623296 00000100:00100000:2.0:1788638483.688273:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183623296 00000100:00100000:2.0:1788638483.688321:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788638483.688329:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183623296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638483.688388:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183623296:12345-0@lo:400:kworker.0 Request processed in 59us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638483.688396:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788638483.688443:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183623296:0@lo:400:kworker.0 00000100:00100000:1.0:1788638483.689014:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183623680 00000100:00100000:1.0:1788638483.689020:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183623680 00000100:00100000:1.0:1788638483.689062:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183623936 00000100:00100000:1.0:1788638483.689065:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183623936 00000100:00100000:1.0:1788638483.689083:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788638483.689090:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183623680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638483.689135:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183623680:12345-0@lo:400:kworker.0 Request processed in 46us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638483.689142:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788638483.689155:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788638483.689161:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183623936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638483.689189:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183623936:12345-0@lo:400:kworker.0 Request processed in 29us (1008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638483.689195:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1788638483.689308:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788638483.689313:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788638483.689337:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73c09a5500 x1875523183623936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638483.689350:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183623936:0@lo:400:kworker.0 00010000:00080000:2.0:1788638483.689385:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73c09a6300 x1875523183623680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638499 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638483.689395:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183623680:0@lo:400:kworker.0 00000100:00100000:0.0:1788638483.689590:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183623808 00000100:00100000:0.0:1788638483.689595:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183623808 00000100:00100000:0.0:1788638483.689643:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183623424 00000100:00100000:0.0:1788638483.689647:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183623424 00000100:00100000:0.0:1788638483.689659:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183623552 00000100:00100000:0.0:1788638483.689661:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183623552 00000100:00100000:0.0:1788638483.689675:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788638483.689681:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183623808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638483.689755:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183623808:12345-0@lo:400:kworker.0 Request processed in 75us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638483.689762:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788638483.689775:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788638483.689801:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183623424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638483.689832:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183623424:12345-0@lo:400:kworker.0 Request processed in 52us (1683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638483.689846:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788638483.689857:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788638483.689863:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183623552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638483.689888:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183623552:12345-0@lo:400:kworker.0 Request processed in 26us (1652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638483.689893:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788638483.689929:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183623808:0@lo:400:kworker.0 00000100:00080000:2.0:1788638483.690206:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638483.690228:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183623552:0@lo:400:kworker.0 00000100:00100000:2.0:1788638483.690238:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183623424:0@lo:400:kworker.0 00000100:00100000:3.0:1788638484.192999:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183624064:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788638484.193071:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638484.193178:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183624064 00000100:00100000:0.0:1788638484.193187:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183624064 00000100:00100000:0.0:1788638484.193247:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788638484.193255:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183624064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788638484.193290:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638484.208607:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183624064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 15333us (15517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638484.208623:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:3.0:1788638484.210385:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73c09a7100 x1875523183624064/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638500 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638484.210416:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183624064:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788638484.388079:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638485.419483:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638486.433759:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638486.752244:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788638486.752268:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183624192:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788638486.752338:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638486.752410:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183624192 00000100:00100000:0.0:1788638486.752418:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183624192 00000100:00100000:0.0:1788638486.752496:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788638486.752505:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183624192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788638486.752541:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638486.752590:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183624192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638486.752597:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1788638486.752637:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c738537aa00 x1875523183624192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638502 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638486.752669:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183624192:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788638486.752732:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788638486.789443:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638486.789485:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638486.789552:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174151936 00000100:00100000:0.0:1788638486.789562:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174151936 00000100:00100000:0.0:1788638486.789629:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 85 00000100:00100000:0.0:1788638486.789639:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2365:x1875523174151936:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638486.789730:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2365:x1875523174151936:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 93us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638486.789738:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 85 00000100:00080000:1.0:1788638486.789957:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638486.790036:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174152192 00000100:00100000:3.0:1788638486.790042:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174152192 00000100:00100000:3.0:1788638486.792687:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 14 00000100:00100000:3.0:1788638486.792701:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2363:x1875523174152192:12345-192.168.203.34@tcp:9:kworker.0 00000020:00000080:3.0:1788638486.792739:0:6684:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a8c2 00000100:00080000:3.0:1788638486.792757:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9c73ad651800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788638486.792811:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000001:00000004:3.0:1788638486.792814:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788638486.792843:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638486.792869:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174151808 00000100:00100000:0.0:1788638486.792875:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174151808 00000100:00100000:0.0:1788638486.792903:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 228 00000100:00100000:0.0:1788638486.792910:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:2364:x1875523174151808:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638486.792959:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:2364:x1875523174151808:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 49us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638486.792965:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 228 00000100:00100000:0.0:1788638486.792993:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174152064 00000100:00100000:0.0:1788638486.792997:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174152064 00000100:00100000:3.0:1788638486.794414:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:cdbf9a9f-afb3-447e-b3b7-3039526706d5+2:2363:x1875523174152192:12345-192.168.203.34@tcp:9:kworker.0 Request processed in 1711us (4923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638486.794426:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 14 00000100:00080000:1.0:1788638486.798188:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788638486.798198:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788638486.798209:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638486.799239:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638486.799428:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174152320 00000100:00100000:3.0:1788638486.799437:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174152320 00000100:00100000:3.0:1788638486.799516:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 15 00000100:00100000:3.0:1788638486.799527:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2363:x1875523174152320:12345-192.168.203.34@tcp:9:kworker.0 00000020:00000080:3.0:1788638486.799552:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a8c9 00000100:00080000:3.0:1788638486.799560:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9c7398785000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788638486.799596:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788638486.799847:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 86 00000100:00100000:0.0:1788638486.799856:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2364:x1875523174152064:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638486.799915:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2364:x1875523174152064:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 60us (7069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638486.799923:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 86 00010000:00010000:1.0:1788638486.800178:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788638486.800188:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788638486.800676:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:cdbf9a9f-afb3-447e-b3b7-3039526706d5+2:2363:x1875523174152320:12345-192.168.203.34@tcp:9:kworker.0 Request processed in 1151us (1441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638486.800685:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 15 00010000:00010000:0.0:1788638487.458434:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638488.481931:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638488.807603:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183624320:0@lo:400:kworker.0 00000100:00100000:0.0:1788638488.807703:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638488.807912:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183624320 00000100:00100000:3.0:1788638488.807921:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183624320 00000100:00100000:3.0:1788638488.807969:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788638488.807977:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183624320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638488.808523:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183624704:0@lo:400:kworker.0 00000100:00100000:2.0:1788638488.808572:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638488.808614:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788638488.808621:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183624832:0@lo:400:kworker.0 00000100:00100000:2.0:1788638488.808648:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638488.808689:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183624448:0@lo:400:kworker.0 00000100:00100000:2.0:1788638488.808725:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638488.808743:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183624960:0@lo:400:kworker.0 00000100:00100000:2.0:1788638488.808762:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638488.808779:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788638488.808808:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183624576:0@lo:400:kworker.0 00000100:00100000:2.0:1788638488.808831:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638488.809197:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183624704 00000100:00100000:1.0:1788638488.809212:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183624704 00000100:00100000:1.0:1788638488.809253:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183624960 00000100:00100000:1.0:1788638488.809256:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183624960 00000100:00100000:1.0:1788638488.809281:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788638488.809288:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183624704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638488.809342:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183624704:12345-0@lo:400:kworker.0 Request processed in 54us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638488.809349:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788638488.809364:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788638488.809369:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183624960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638488.809397:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183624960:12345-0@lo:400:kworker.0 Request processed in 28us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638488.809403:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788638488.809416:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788638488.809419:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788638488.809442:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b4f25f80 x1875523183624704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638488.809463:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f25f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183624704:0@lo:400:kworker.0 00010000:00080000:1.0:1788638488.809494:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b4f24700 x1875523183624960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638504 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638488.809505:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183624960:0@lo:400:kworker.0 00000100:00100000:3.0:1788638488.817360:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183624320:12345-0@lo:400:kworker.0 Request processed in 9372us (9646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638488.817376:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788638488.817856:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183624832 00000100:00100000:1.0:1788638488.817865:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183624832 00000100:00100000:1.0:1788638488.817916:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183624448 00000100:00100000:1.0:1788638488.817919:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183624448 00000100:00100000:1.0:1788638488.817929:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183624576 00000100:00100000:1.0:1788638488.817932:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183624576 00000100:00100000:1.0:1788638488.817947:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788638488.817955:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183624832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638488.818023:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183624832:12345-0@lo:400:kworker.0 Request processed in 69us (9373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638488.818029:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788638488.818040:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788638488.818046:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183624448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638488.818071:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183624448:12345-0@lo:400:kworker.0 Request processed in 26us (9346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638488.818077:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788638488.818085:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788638488.818090:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183624576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638488.818112:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183624576:12345-0@lo:400:kworker.0 Request processed in 21us (9280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638488.818117:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788638488.818170:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f24380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183624832:0@lo:400:kworker.0 00000100:00100000:1.0:1788638488.818214:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183624576:0@lo:400:kworker.0 00000100:00100000:1.0:1788638488.818226:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183624448:0@lo:400:kworker.0 00000100:00080000:3.0:1788638488.818851:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638488.820377:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183624320:0@lo:400:kworker.0 00000100:00100000:3.0:1788638489.312056:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183625088:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788638489.312131:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638489.312324:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183625088 00000100:00100000:2.0:1788638489.312332:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183625088 00000100:00100000:2.0:1788638489.312390:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788638489.312401:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183625088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788638489.312435:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788638489.312705:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183625088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 305us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638489.312714:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1788638489.314339:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73837d7b80 x1875523183625088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638505 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638489.314366:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183625088:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788638489.503947:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638490.531816:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788638490.644745:0:11036:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1788638490.927034:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of cdbf9a9f-afb3-447e-b3b7-3039526706d5 00000020:00000080:3.0:1788638490.927044:0:7651:0:(genops.c:885:class_export_put()) final put ffff9c73ad655800/cdbf9a9f-afb3-447e-b3b7-3039526706d5 00000020:00000080:1.0:1788638490.927100:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73ad655800/cdbf9a9f-afb3-447e-b3b7-3039526706d5 for lustre-OST0001 00000020:00000080:1.0:1788638490.927148:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c7398785000 for lustre-OST0001 00010000:00010000:1.0:1788638491.552320:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638491.880636:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183625216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788638491.880717:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638491.883358:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183625216 00000100:00100000:1.0:1788638491.883373:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183625216 00000100:00100000:1.0:1788638491.883454:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788638491.883465:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183625216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788638491.883500:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788638491.883571:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183625216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (2853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638491.883579:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1788638491.884554:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788638491.884615:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73c09a5880 x1875523183625216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638507 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638491.884639:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183625216:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788638491.914779:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638491.914829:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638491.914856:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638491.914881:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174152704 00000100:00100000:1.0:1788638491.914891:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174152704 00000100:00100000:1.0:1788638491.914945:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174152576 00000100:00100000:1.0:1788638491.914949:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174152576 00000100:00100000:1.0:1788638491.914973:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 90 00000100:00100000:1.0:1788638491.914983:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2367:x1875523174152704:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638491.914998:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174152448 00000100:00100000:3.0:1788638491.915002:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174152448 00000100:00100000:1.0:1788638491.915049:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2367:x1875523174152704:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 67us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638491.915066:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 90 00000100:00100000:1.0:1788638491.915083:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 91 00000100:00100000:1.0:1788638491.915089:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2367:x1875523174152576:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638491.915116:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2367:x1875523174152576:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 27us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638491.915123:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 91 00000100:00080000:0.0:1788638491.915477:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638491.925544:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 230 00000100:00100000:2.0:1788638491.925559:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+13:2367:x1875523174152448:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638491.925636:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+13:2367:x1875523174152448:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 80us (10865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638491.925644:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 230 00000001:00100000:2.0:1788638491.990339:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of cdbf9a9f-afb3-447e-b3b7-3039526706d5 00000020:00000080:2.0:1788638491.990354:0:6711:0:(genops.c:885:class_export_put()) final put ffff9c73ad653000/cdbf9a9f-afb3-447e-b3b7-3039526706d5 00000020:00000080:2.0:1788638491.990383:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73ad653000/cdbf9a9f-afb3-447e-b3b7-3039526706d5 for lustre-OST0000 00000020:00000080:2.0:1788638491.990435:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73ad651800 for lustre-OST0000 00010000:00010000:1.0:1788638492.577394:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638493.601640:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638493.922822:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183625344:0@lo:400:kworker.0 00000100:00100000:2.0:1788638493.922923:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638493.922988:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183625856:0@lo:400:kworker.0 00000100:00100000:2.0:1788638493.923018:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638493.923045:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788638493.923051:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183625728:0@lo:400:kworker.0 00000100:00100000:2.0:1788638493.923078:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638493.923280:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183625472:0@lo:400:kworker.0 00000100:00100000:3.0:1788638493.923313:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638493.923351:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183625984:0@lo:400:kworker.0 00000100:00100000:3.0:1788638493.923371:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638493.923390:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788638493.923395:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183625600:0@lo:400:kworker.0 00000100:00100000:3.0:1788638493.923432:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638493.923468:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183625728 00000100:00100000:3.0:1788638493.923477:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183625728 00000100:00100000:3.0:1788638493.923549:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183625984 00000100:00100000:3.0:1788638493.923552:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183625984 00000100:00100000:3.0:1788638493.923570:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788638493.923579:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183625728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638493.923858:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183625728:12345-0@lo:400:kworker.0 Request processed in 278us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638493.923867:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788638493.923886:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788638493.923893:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183625984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638493.923925:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183625984:12345-0@lo:400:kworker.0 Request processed in 33us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638493.923931:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1788638493.923948:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788638493.923959:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788638493.923993:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7384c2b800 x1875523183625984/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638493.924009:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183625984:0@lo:400:kworker.0 00000100:00100000:2.0:1788638493.925551:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183625856 00000100:00100000:2.0:1788638493.925568:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183625856 00000100:00100000:2.0:1788638493.925669:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183625472 00000100:00100000:2.0:1788638493.925673:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183625472 00000100:00100000:2.0:1788638493.925689:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183625600 00000100:00100000:2.0:1788638493.925692:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183625600 00000100:00100000:2.0:1788638493.925710:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788638493.925719:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183625856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638493.925845:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183625856:12345-0@lo:400:kworker.0 Request processed in 127us (2825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638493.925853:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788638493.925870:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788638493.925876:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183625472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638493.925914:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183625472:12345-0@lo:400:kworker.0 Request processed in 39us (2601us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638493.925920:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788638493.925951:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788638493.925956:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183625600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638493.925986:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183625600:12345-0@lo:400:kworker.0 Request processed in 30us (2553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638493.925993:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788638493.926044:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183625600:0@lo:400:kworker.0 00000100:00100000:2.0:1788638493.926058:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183625472:0@lo:400:kworker.0 00010000:00080000:2.0:1788638493.926105:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7384c2a300 x1875523183625728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638509 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638493.926117:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183625728:0@lo:400:kworker.0 00000100:00100000:2.0:1788638493.926130:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183625856:0@lo:400:kworker.0 00000100:00100000:0.0:1788638493.926559:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183625344 00000100:00100000:0.0:1788638493.926567:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183625344 00000100:00100000:0.0:1788638493.926607:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788638493.926614:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183625344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638493.926682:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183625344:12345-0@lo:400:kworker.0 Request processed in 68us (3759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638493.926689:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788638493.926869:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183625344:0@lo:400:kworker.0 00000100:00080000:3.0:1788638493.930712:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638494.443418:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183626112:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788638494.443533:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638494.443973:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183626112 00000100:00100000:2.0:1788638494.443985:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183626112 00000100:00100000:2.0:1788638494.444063:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788638494.444075:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183626112:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788638494.444125:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788638494.453250:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bf8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183626112:12345-0@lo:13:osp-pre-1-0.0 Request processed in 9160us (9700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638494.453269:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788638494.458651:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73837d7800 x1875523183626112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638510 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638494.458693:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183626112:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788638494.642000:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638495.651328:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788638495.678716:0:11186:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffd9f83aa0 20000000:00000080:1.0:1788638495.678748:0:11186:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c73b486b000 uarg=0000000000000000 20000000:01000000:1.0:1788638495.678982:0:11186:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788638495.678989:0:11186:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788638495.678995:0:11186:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788638495.692767:0:11187:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788638495.693945:0:11186:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788638495.702996:0:11186:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788638495.703056:0:11186:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7385309e00/0xa0b1f1e3b4b2a8d0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.703077:0:11186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2a87c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a875 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.703085:0:11186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7385309600/0xa0b1f1e3b4b2a88a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a883 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.703092:0:11186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2a898 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a891 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.703101:0:11186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2a89f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d35 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.703130:0:11186:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a8b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d6d expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.703139:0:11186:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7385309e00/0xa0b1f1e3b4b2a8d0 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.703191:0:11186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a8b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d6d expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.703205:0:11186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a8b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d6d expref: 12 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638495.703232:0:11186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11186:1875523183626240:192.168.203.34@tcp:104: 00010000:00010000:1.0:1788638495.703417:0:11186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2a89f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d35 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.703426:0:11186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2a89f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d35 expref: 12 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638495.703435:0:11186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11186:1875523183626368:192.168.203.34@tcp:104: 00010000:00010000:1.0:1788638495.703462:0:11186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2a898 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a891 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.703470:0:11186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2a898 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a891 expref: 18 pid: 5837 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638495.703479:0:11186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11186:1875523183626496:0@lo:104: 00000100:00100000:1.0:1788638495.703518:0:11186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788638495.703633:0:11186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7385309600/0xa0b1f1e3b4b2a88a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a883 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.703643:0:11186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7385309600/0xa0b1f1e3b4b2a88a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a883 expref: 18 pid: 5834 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638495.703663:0:11186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11186:1875523183626624:0@lo:104: 00000100:00100000:1.0:1788638495.703683:0:11186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638495.721737:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638495.721774:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638495.721829:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174152960 00000100:00100000:3.0:1788638495.721841:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174152960 00010000:00010000:3.0:1788638495.721888:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2a89f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d35 expref: 13 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638495.721925:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174152832 00000100:00100000:3.0:1788638495.721928:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174152832 00010000:00010000:3.0:1788638495.721942:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a8b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d6d expref: 14 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638495.721959:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 25 00000100:00100000:3.0:1788638495.721970:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dfc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55273f9a-386c-4321-9748-c194b047efe8+14:2364:x1875523174152960:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788638495.721987:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638495.722011:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2a89f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d35 expref: 14 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638495.722026:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2a89f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d35 expref: 14 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638495.722052:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638495.722118:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dfc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55273f9a-386c-4321-9748-c194b047efe8+14:2364:x1875523174152960:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 150us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638495.722127:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 25 00000100:00100000:3.0:1788638495.722180:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 26 00000100:00100000:3.0:1788638495.722186:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55273f9a-386c-4321-9748-c194b047efe8+13:2364:x1875523174152832:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788638495.722194:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638495.722198:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a8b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d6d expref: 13 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638495.722208:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a8b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d6d expref: 13 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638495.722218:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638495.722248:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55273f9a-386c-4321-9748-c194b047efe8+13:2364:x1875523174152832:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 61us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638495.722254:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 26 00010000:00010000:1.0:1788638495.724157:0:11186:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2a87c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a875 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.724176:0:11186:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2a87c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a875 expref: 18 pid: 5834 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638495.724192:0:11186:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11186:1875523183626752:0@lo:104: 00000100:00100000:1.0:1788638495.724267:0:11186:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638495.727754:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183626496 00000100:00100000:2.0:1788638495.727779:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183626496 00000100:00100000:1.0:1788638495.732143:0:11186:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b4640d80 going to sleep for 11 seconds 00010000:00010000:1.0:1788638495.732202:0:11186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a8b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d6d expref: 12 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638495.732421:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183626624 00000100:00100000:2.0:1788638495.732429:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183626624 00000100:00100000:2.0:1788638495.732465:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183626752 00000100:00100000:2.0:1788638495.732469:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183626752 00000100:00100000:2.0:1788638495.732484:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788638495.732494:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+5:11186:x1875523183626496:12345-0@lo:104: 00010000:00010000:2.0:1788638495.732517:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c73813fda00/0xa0b1f1e3b4b2a891 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a898 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638495.732617:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788638495.732624:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+5:11186:x1875523183626496:12345-0@lo:104: Request processed in 131us (29106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638495.732631:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788638495.732659:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788638495.732666:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+4:11186:x1875523183626624:12345-0@lo:104: 00010000:00010000:2.0:1788638495.732675:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a883 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a88a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638495.732714:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788638495.732720:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+4:11186:x1875523183626624:12345-0@lo:104: Request processed in 56us (29037us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638495.732726:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788638495.732750:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788638495.732756:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:11186:x1875523183626752:12345-0@lo:104: 00010000:00010000:2.0:1788638495.732764:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2a875 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a87c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638495.732825:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788638495.732830:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f24380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:11186:x1875523183626752:12345-0@lo:104: Request processed in 75us (8564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638495.732846:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1788638495.733185:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788638495.733194:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c73813fda00/0xa0b1f1e3b4b2a891 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a898 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638495.733203:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fda00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:0.0:1788638495.733208:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c73813fda00/0xa0b1f1e3b4b2a891 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a898 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638495.733240:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c73813fda00/0xa0b1f1e3b4b2a891 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a898 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638495.733248:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c73813fda00/0xa0b1f1e3b4b2a891 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a898 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638495.733255:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788638495.733308:0:7639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c73813fda00/0xa0b1f1e3b4b2a891 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a898 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638495.733314:0:7639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788638495.733351:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c73813fda00/0xa0b1f1e3b4b2a891 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a898 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638495.733359:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c73813fda00/0xa0b1f1e3b4b2a891 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a898 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638495.733375:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788638495.733377:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a883 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a88a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638495.733383:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7000 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:0.0:1788638495.733386:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a883 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a88a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638495.733392:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a883 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a88a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638495.733398:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a883 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a88a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638495.733410:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788638495.733425:0:7639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a883 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a88a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638495.733431:0:7639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788638495.733438:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a883 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a88a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638495.733444:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a883 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a88a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638495.733454:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638495.733456:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2a875 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a87c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638495.733461:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fc400 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:0.0:1788638495.733464:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2a875 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a87c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638495.733470:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2a875 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a87c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638495.733476:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2a875 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a87c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638495.733481:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788638495.733493:0:7639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2a875 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a87c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638495.733499:0:7639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788638495.733523:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2a875 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a87c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638495.733531:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c73813fc400/0xa0b1f1e3b4b2a875 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a87c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638495.733548:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638495.733550:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638495.733552:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638495.733571:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183626880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788638495.733623:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638495.733666:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788638495.733672:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183627008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788638495.733693:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638495.733726:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183627136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788638495.733757:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638495.734052:0:11186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11186:1875523183626240:192.168.203.34@tcp:104: 00010000:00010000:1.0:1788638495.734085:0:11186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73813fd000/0xa0b1f1e3b4b2a89f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d35 expref: 11 pid: 5837 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638495.734098:0:11186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a4380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11186:1875523183626368:192.168.203.34@tcp:104: 00000100:00100000:1.0:1788638495.734109:0:11186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11186:1875523183626496:0@lo:104: 00000100:00100000:1.0:1788638495.734120:0:11186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11186:1875523183626624:0@lo:104: 00000100:00100000:1.0:1788638495.734127:0:11186:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11186:1875523183626752:0@lo:104: 00010000:00010000:1.0:1788638495.734161:0:11186:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7385309e00/0xa0b1f1e3b4b2a8d0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.734283:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638495.734291:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638495.734314:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183626880 00000100:00100000:1.0:1788638495.734320:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183626880 00010000:00010000:1.0:1788638495.734408:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2a898 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a891 expref: 19 pid: 5837 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638495.734428:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183627008 00000100:00100000:1.0:1788638495.734431:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183627008 00010000:00010000:1.0:1788638495.734441:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7385309600/0xa0b1f1e3b4b2a88a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a883 expref: 20 pid: 5834 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638495.734449:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183627136 00000100:00100000:1.0:1788638495.734451:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183627136 00010000:00010000:1.0:1788638495.734461:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2a87c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a875 expref: 21 pid: 5834 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638495.734474:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788638495.734481:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+21:3293:x1875523183626880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788638495.734493:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638495.734500:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2a898 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a891 expref: 21 pid: 5837 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.734511:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2a898 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a891 expref: 21 pid: 5837 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.734529:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73813fce00/0xa0b1f1e3b4b2a898 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a891 expref: 21 pid: 5837 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.734543:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638495.734608:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c29f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+20:3293:x1875523183626880:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638495.734615:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788638495.734632:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788638495.734638:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183627008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788638495.734654:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638495.734659:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7385309600/0xa0b1f1e3b4b2a88a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a883 expref: 19 pid: 5834 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.734667:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7385309600/0xa0b1f1e3b4b2a88a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a883 expref: 19 pid: 5834 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.734677:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7385309600/0xa0b1f1e3b4b2a88a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a883 expref: 19 pid: 5834 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.734685:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638495.734706:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:3293:x1875523183627008:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (1013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638495.734711:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788638495.734722:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788638495.734727:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:3291:x1875523183627136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788638495.734734:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638495.734749:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2a87c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a875 expref: 17 pid: 5834 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.734758:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2a87c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a875 expref: 17 pid: 5834 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.734766:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2a87c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a875 expref: 17 pid: 5834 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.734823:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7385309e00/0xa0b1f1e3b4b2a8d0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.734833:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7385309e00/0xa0b1f1e3b4b2a8d0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.734850:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7385309e00/0xa0b1f1e3b4b2a8d0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.734857:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7385309e00/0xa0b1f1e3b4b2a8d0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.734864:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7385309e00/0xa0b1f1e3b4b2a8d0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.734870:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7385309e00/0xa0b1f1e3b4b2a8d0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.734876:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309e00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638495.734880:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7385309e00/0xa0b1f1e3b4b2a8d0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.734888:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7385309e00/0xa0b1f1e3b4b2a8d0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.734899:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7385309e00/0xa0b1f1e3b4b2a8d0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.734908:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638495.734932:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c29880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:3291:x1875523183627136:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638495.734946:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1788638495.734974:0:11186:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7385309e00/0xa0b1f1e3b4b2a8d0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.734982:0:11186:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7385309e00/0xa0b1f1e3b4b2a8d0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638495.734989:0:11186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7385309e00/0xa0b1f1e3b4b2a8d0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11186 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638495.736884:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183627136:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788638495.736948:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183627008:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788638495.736959:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183626880:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788638496.671965:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638496.995164:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788638496.995195:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183627264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788638497.002162:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638497.002271:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183627264 00000100:00100000:1.0:1788638497.002284:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183627264 00000100:00100000:1.0:1788638497.002356:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788638497.002367:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183627264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788638497.002418:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788638497.002471:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f25f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183627264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638497.002479:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788638497.002501:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788638497.002596:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b4f24700 x1875523183627264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638512 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638497.002620:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f24700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183627264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788638497.027035:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638497.027087:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638497.027112:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638497.027146:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174153216 00000100:00100000:3.0:1788638497.027158:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174153216 00000100:00100000:3.0:1788638497.027222:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174153344 00000100:00100000:3.0:1788638497.027242:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174153344 00000100:00100000:3.0:1788638497.027272:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 95 00000100:00100000:3.0:1788638497.027283:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2367:x1875523174153216:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638497.027373:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2367:x1875523174153216:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 91us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638497.027381:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 95 00000100:00100000:3.0:1788638497.027399:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 96 00000100:00100000:3.0:1788638497.027404:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2367:x1875523174153344:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638497.027426:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2367:x1875523174153344:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 22us (314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638497.027432:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 96 00000100:00080000:3.0:1788638497.027448:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638497.028020:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174153088 00000100:00100000:3.0:1788638497.028027:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174153088 00000100:00100000:3.0:1788638497.028061:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 232 00000100:00100000:3.0:1788638497.028069:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+11:2367:x1875523174153088:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638497.028107:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+11:2367:x1875523174153088:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 38us (1019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638497.028114:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 232 00000100:00100000:3.0:1788638497.153691:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638497.154162:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174153472 00000100:00100000:0.0:1788638497.154176:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174153472 00000100:00100000:0.0:1788638497.154245:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 233 00000100:00100000:0.0:1788638497.154257:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+11:5608:x1875523174153472:12345-192.168.203.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788638497.154278:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638497.154305:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73bc01d000/0xa0b1f1e3b4b2a8d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434d97 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638497.154360:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73bc01d000/0xa0b1f1e3b4b2a8d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d97 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638497.154375:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73bc01d000/0xa0b1f1e3b4b2a8d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d97 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638497.154388:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01d000, rc 0) 00000100:00100000:0.0:1788638497.154474:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+12:5608:x1875523174153472:12345-192.168.203.34@tcp:101:ll_cfg_requeue.0 Request processed in 219us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638497.154482:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 233 00000100:00100000:0.0:1788638497.158696:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638497.158752:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174153600 00000100:00100000:0.0:1788638497.158763:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174153600 00000100:00100000:0.0:1788638497.158841:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 234 00000100:00100000:0.0:1788638497.158853:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+12:5608:x1875523174153600:12345-192.168.203.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638497.159204:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+12:5608:x1875523174153600:12345-192.168.203.34@tcp:501:ll_cfg_requeue.0 Request processed in 353us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638497.159213:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 234 00000100:00100000:0.0:1788638497.163060:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638497.163135:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174153728 00000100:00100000:2.0:1788638497.163149:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174153728 00000100:00100000:2.0:1788638497.168156:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 235 00000100:00100000:2.0:1788638497.168190:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+12:5608:x1875523174153728:12345-192.168.203.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788638497.168516:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+12:5608:x1875523174153728:12345-192.168.203.34@tcp:503:ll_cfg_requeue.0 Request processed in 342us (5469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638497.168526:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 235 00000100:00100000:3.0:1788638497.183666:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638497.183860:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174153856 00000100:00100000:2.0:1788638497.183873:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174153856 00000100:00100000:2.0:1788638497.183948:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 236 00000100:00100000:2.0:1788638497.183959:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+12:5608:x1875523174153856:12345-192.168.203.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788638497.183982:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638497.184006:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a8de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434d9e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638497.184041:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a8de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d9e expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638497.184053:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a8de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d9e expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638497.184063:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7400, rc 0) 00000100:00100000:2.0:1788638497.184133:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:5608:x1875523174153856:12345-192.168.203.34@tcp:101:ll_cfg_requeue.0 Request processed in 176us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638497.184141:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 236 00000100:00100000:0.0:1788638497.191112:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638497.191773:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174153984 00000100:00100000:2.0:1788638497.191802:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174153984 00000100:00100000:2.0:1788638497.191861:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 237 00000100:00100000:2.0:1788638497.191873:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+13:5608:x1875523174153984:12345-192.168.203.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788638497.192228:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+13:5608:x1875523174153984:12345-192.168.203.34@tcp:501:ll_cfg_requeue.0 Request processed in 355us (1127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638497.192237:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 237 00000100:00100000:3.0:1788638497.194097:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638497.194143:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174154112 00000100:00100000:3.0:1788638497.194151:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174154112 00000100:00100000:3.0:1788638497.194197:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 238 00000100:00100000:3.0:1788638497.194207:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:5608:x1875523174154112:12345-192.168.203.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788638497.197721:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:5608:x1875523174154112:12345-192.168.203.34@tcp:503:ll_cfg_requeue.0 Request processed in 3497us (3616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638497.197742:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 238 10000000:01000000:2.0:1788638497.503908:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788638497.503918:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c73b4c0d800 from 7 10000000:01000000:2.0:1788638497.503925:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788638497.503992:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a8e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638497.504006:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a8e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638497.504019:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a8e5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638497.504053:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183627392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788638497.504144:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638497.504217:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b4e0bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788638497.504285:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183627392 00000100:00100000:3.0:1788638497.504295:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183627392 00000100:00100000:3.0:1788638497.504378:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788638497.504389:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:5840:x1875523183627392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788638497.504406:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638497.504424:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a8ec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a8e5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638497.504455:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a8ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a8e5 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638497.504469:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a8ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a8e5 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638497.504479:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031c00, rc 0) 00000100:00100000:3.0:1788638497.504540:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183627392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638497.504547:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788638497.504983:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183627392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788638497.505003:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a8e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a8ec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638497.505015:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a8e5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a8ec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638497.505105:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183627520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638497.505142:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638497.505214:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738390ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788638497.511014:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183627520 00000100:00100000:3.0:1788638497.511036:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183627520 00000100:00100000:3.0:1788638497.511111:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1788638497.511124:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183627520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788638497.511516:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183627520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 394us (6371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638497.511535:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788638497.511877:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c2aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183627520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788638497.511957:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183627648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788638497.512012:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638497.512053:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b4640cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638497.512547:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183627648 00000100:00100000:3.0:1788638497.512555:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183627648 00000100:00100000:3.0:1788638497.512610:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1788638497.512618:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183627648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788638497.512869:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183627648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 251us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638497.512877:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788638497.512971:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f24700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183627648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788638497.517057:0:11235:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788638497.524996:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788638497.525052:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788638497.525068:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a8e5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a8ec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638497.525083:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a8e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a8ec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638497.525096:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788638497.525099:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c73bce5d800 from 7 10000000:01000000:3.0:1788638497.525102:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788638497.525154:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a8f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638497.525163:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a8f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638497.525177:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a8f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638497.525211:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7398bf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183627776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788638497.525316:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638497.525386:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398a6bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788638497.526650:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183627776 00000100:00100000:0.0:1788638497.526663:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183627776 00000100:00100000:0.0:1788638497.526738:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788638497.526750:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183627776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788638497.526769:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638497.526809:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2a8fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a8f3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638497.526843:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2a8fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a8f3 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638497.526857:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2a8fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a8f3 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638497.526869:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01dc00, rc 0) 00000100:00100000:0.0:1788638497.526947:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183627776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 199us (1630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638497.526955:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788638497.527020:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7398bf9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183627776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788638497.527044:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a8f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a8fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638497.527055:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a8f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a8fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638497.527146:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183627904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638497.527182:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638497.527199:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387d17540 going to sleep for 11 seconds 00000100:00100000:1.0:1788638497.527357:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183627904 00000100:00100000:1.0:1788638497.527439:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183627904 00000100:00100000:1.0:1788638497.527477:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1788638497.527485:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183627904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788638497.528105:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183627904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 618us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638497.528115:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788638497.530040:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183627904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638497.530113:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183628032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788638497.530189:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638497.530241:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387d17540 going to sleep for 11 seconds 00000100:00100000:1.0:1788638497.530299:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183628032 00000100:00100000:1.0:1788638497.530309:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183628032 00000100:00100000:1.0:1788638497.530507:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788638497.530518:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183628032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788638497.531042:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183628032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 525us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638497.531052:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788638497.531469:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183628032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788638497.535316:0:11238:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788638497.536737:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788638497.536765:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788638497.536793:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a8f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a8fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638497.536808:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a8f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a8fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638497.536821:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788638497.536824:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7387a11800 from 7 10000000:01000000:0.0:1788638497.536828:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788638497.536879:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01de00/0xa0b1f1e3b4b2a901 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638497.536889:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73bc01de00/0xa0b1f1e3b4b2a901 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638497.536902:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73bc01de00/0xa0b1f1e3b4b2a901 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638497.536944:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183628160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788638497.537034:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638497.537083:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387d17540 going to sleep for 11 seconds 00000100:00100000:0.0:1788638497.537110:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183628160 00000100:00100000:0.0:1788638497.537118:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183628160 00000100:00100000:0.0:1788638497.537172:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788638497.537183:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183628160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788638497.537198:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638497.537214:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2a908 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2a901 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638497.537242:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2a908 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a901 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638497.537254:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2a908 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a901 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638497.537264:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01ca00, rc 0) 00000100:00100000:0.0:1788638497.537307:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:5840:x1875523183628160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638497.537314:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788638497.537681:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183628160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788638497.537701:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73bc01de00/0xa0b1f1e3b4b2a901 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a908 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638497.537713:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73bc01de00/0xa0b1f1e3b4b2a901 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a908 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638497.537920:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183628288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638497.537959:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638497.537987:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387d17540 going to sleep for 11 seconds 00000100:00100000:1.0:1788638497.539838:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183628288 00000100:00100000:1.0:1788638497.539858:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183628288 00000100:00100000:1.0:1788638497.539924:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788638497.539935:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:5840:x1875523183628288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788638497.540304:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386790850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:5840:x1875523183628288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 369us (2343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638497.540313:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788638497.540518:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183628288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638497.540580:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183628416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788638497.540660:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638497.540707:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387d17540 going to sleep for 11 seconds 00000100:00100000:1.0:1788638497.540877:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183628416 00000100:00100000:1.0:1788638497.540889:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183628416 00000100:00100000:1.0:1788638497.540926:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788638497.540933:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:5840:x1875523183628416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788638497.541098:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386792850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:5840:x1875523183628416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638497.541105:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788638497.541179:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c28700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183628416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788638497.542076:0:11240:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788638497.542314:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788638497.542332:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788638497.542346:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01de00/0xa0b1f1e3b4b2a901 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a908 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638497.542358:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73bc01de00/0xa0b1f1e3b4b2a901 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a908 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638497.697042:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638498.721005:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638499.043015:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788638499.043084:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183628672:0@lo:400:kworker.0 00000100:00100000:2.0:1788638499.043168:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638499.043231:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183628544:0@lo:400:kworker.0 00000100:00100000:3.0:1788638499.043247:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183628672 00000100:00100000:3.0:1788638499.043256:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183628672 00000100:00100000:2.0:1788638499.043269:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638499.043323:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788638499.043348:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183628544 00000100:00100000:1.0:1788638499.043352:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183628544 00000100:00100000:1.0:1788638499.043383:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788638499.043391:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183628544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638499.043449:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386791c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183628544:12345-0@lo:400:kworker.0 Request processed in 59us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638499.043457:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788638499.043465:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183628928:0@lo:400:kworker.0 00000100:00100000:1.0:1788638499.043492:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183628800:0@lo:400:kworker.0 00000100:00100000:1.0:1788638499.043517:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638499.043564:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183628672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638499.043580:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638499.043613:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183628672:12345-0@lo:400:kworker.0 Request processed in 52us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638499.043614:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183628928 00000100:00100000:0.0:1788638499.043617:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183628928 00000100:00100000:1.0:1788638499.043642:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183628800 00000100:00100000:1.0:1788638499.043646:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183628800 00000100:00100000:0.0:1788638499.043672:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788638499.043679:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183628928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638499.043714:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183628928:12345-0@lo:400:kworker.0 Request processed in 36us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638499.043721:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1788638499.043740:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788638499.043744:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788638499.043771:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7384c2ad80 x1875523183628928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638499.043805:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183628928:0@lo:400:kworker.0 00000100:00100000:0.0:1788638499.044664:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183629056:0@lo:400:kworker.0 00000100:00100000:0.0:1788638499.044708:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638499.044735:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788638499.044742:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183629184:0@lo:400:kworker.0 00000100:00100000:0.0:1788638499.044765:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638499.044817:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183629056 00000100:00100000:0.0:1788638499.044822:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183629056 00000100:00100000:2.0:1788638499.045827:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183628672:0@lo:400:kworker.0 00000100:00100000:2.0:1788638499.045854:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183628544:0@lo:400:kworker.0 00000100:00100000:3.0:1788638499.047396:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788638499.048673:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788638499.048700:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183628800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638499.048716:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183629184 00000100:00100000:3.0:1788638499.048726:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183629184 00000100:00100000:3.0:1788638499.048770:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788638499.048777:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183629184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638499.048919:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788638499.048930:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183629056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638499.049186:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f24700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183628800:12345-0@lo:400:kworker.0 Request processed in 499us (5666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638499.049195:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788638499.049208:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183629184:12345-0@lo:400:kworker.0 Request processed in 431us (4441us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638499.049214:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788638499.049230:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788638499.049234:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638499.049249:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183628800:0@lo:400:kworker.0 00000100:00100000:1.0:1788638499.051174:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183629056:12345-0@lo:400:kworker.0 Request processed in 2235us (6453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638499.051188:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00010000:00080000:2.0:1788638499.052436:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7384c2b100 x1875523183629184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638515 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638499.052457:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183629184:0@lo:400:kworker.0 00000100:00100000:2.0:1788638499.052480:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183629056:0@lo:400:kworker.0 00000100:00100000:2.0:1788638499.552637:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183629312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788638499.552730:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638499.553994:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183629312 00000100:00100000:3.0:1788638499.554010:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183629312 00000100:00100000:3.0:1788638499.554074:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788638499.554084:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183629312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788638499.554129:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788638499.554511:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183629312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 426us (1779us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638499.554521:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788638499.554582:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73837d6a00 x1875523183629312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638515 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638499.554604:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183629312:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788638499.743948:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638500.769093:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788638501.175311:0:11386:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg334-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788638501.792048:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638502.112257:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183629440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788638502.112332:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638502.112484:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183629440 00000100:00100000:1.0:1788638502.112492:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183629440 00000100:00100000:1.0:1788638502.112776:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788638502.112808:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183629440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788638502.112846:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788638502.112898:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183629440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638502.112906:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:3.0:1788638502.112956:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788638502.112986:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73837d6a00 x1875523183629440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638518 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638502.113005:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183629440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788638502.154402:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638502.154888:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174154240 00000100:00100000:0.0:1788638502.154911:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174154240 00000100:00100000:3.0:1788638502.155301:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638502.155442:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 249 00000100:00100000:0.0:1788638502.155465:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+13:2365:x1875523174154240:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638502.155545:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386792050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+13:2365:x1875523174154240:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 93us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638502.155553:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 249 00000100:00100000:3.0:1788638502.155832:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638502.156968:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174154496 00000100:00100000:2.0:1788638502.156979:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174154496 00000100:00100000:2.0:1788638502.157102:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174154368 00000100:00100000:2.0:1788638502.157106:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174154368 00000100:00100000:0.0:1788638502.157135:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 100 00000100:00100000:0.0:1788638502.157146:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2365:x1875523174154496:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638502.157229:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2365:x1875523174154496:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 84us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638502.157237:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 100 00000100:00080000:3.0:1788638502.157825:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638502.157951:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 101 00000100:00100000:2.0:1788638502.157960:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2365:x1875523174154368:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638502.158012:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2365:x1875523174154368:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 53us (2180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638502.158020:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 101 00010000:00010000:3.0:1788638502.815984:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638503.846000:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638504.164977:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183629824:0@lo:400:kworker.0 00000100:00100000:1.0:1788638504.165049:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638504.165125:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788638504.165132:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b465b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183629952:0@lo:400:kworker.0 00000100:00100000:1.0:1788638504.165161:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638504.165346:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183629824 00000100:00100000:2.0:1788638504.165354:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183629824 00000100:00100000:2.0:1788638504.165427:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788638504.165438:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183629824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638504.165496:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183629824:12345-0@lo:400:kworker.0 Request processed in 60us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638504.165519:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1788638504.165694:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638504.165746:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183629824:0@lo:400:kworker.0 00000100:00100000:0.0:1788638504.165827:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183629568:0@lo:400:kworker.0 00000100:00100000:0.0:1788638504.165865:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638504.165898:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b465bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183630080:0@lo:400:kworker.0 00000100:00100000:0.0:1788638504.165922:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638504.165962:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788638504.165968:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b465aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183629696:0@lo:400:kworker.0 00000100:00100000:0.0:1788638504.165992:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638504.166013:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b465b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183630208:0@lo:400:kworker.0 00000100:00100000:0.0:1788638504.166036:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638504.166062:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183629952 00000100:00100000:0.0:1788638504.166066:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183629952 00000100:00100000:0.0:1788638504.166102:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183630208 00000100:00100000:0.0:1788638504.166105:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183630208 00000100:00100000:0.0:1788638504.166120:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788638504.166126:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183629952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638504.166166:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183629952:12345-0@lo:400:kworker.0 Request processed in 40us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638504.166173:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788638504.166185:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788638504.166190:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183630208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638504.166317:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183629568 00000100:00100000:1.0:1788638504.166321:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183629568 00000100:00100000:1.0:1788638504.166353:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788638504.166360:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183629568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638504.166403:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386792c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183629568:12345-0@lo:400:kworker.0 Request processed in 44us (537us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638504.166409:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788638504.166457:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183630080 00000100:00100000:1.0:1788638504.166470:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183630080 00000100:00100000:1.0:1788638504.166495:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183629696 00000100:00100000:1.0:1788638504.166498:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183629696 00000100:00100000:1.0:1788638504.166515:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788638504.166521:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183630080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638504.166689:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c29c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183630080:12345-0@lo:400:kworker.0 Request processed in 167us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638504.166696:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788638504.166710:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788638504.166716:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183629696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638504.166744:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183629696:12345-0@lo:400:kworker.0 Request processed in 28us (751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638504.166749:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1788638504.166764:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788638504.166768:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788638504.166770:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788638504.166832:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b465aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183629696:0@lo:400:kworker.0 00010000:00080000:1.0:1788638504.166845:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b465b800 x1875523183630208/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638504.166854:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b465b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183630208:0@lo:400:kworker.0 00000100:00100000:1.0:1788638504.166861:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183629568:0@lo:400:kworker.0 00000100:00100000:1.0:1788638504.166869:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b465bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183630080:0@lo:400:kworker.0 00010000:00080000:1.0:1788638504.166907:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b465b480 x1875523183629952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638520 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638504.166916:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b465b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183629952:0@lo:400:kworker.0 00000100:00100000:0.0:1788638504.167111:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183630208:12345-0@lo:400:kworker.0 Request processed in 28us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638504.167129:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788638504.678533:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788638504.678555:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183630336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788638504.678641:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638504.678712:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183630336 00000100:00100000:2.0:1788638504.678720:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183630336 00000100:00100000:2.0:1788638504.678765:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788638504.678773:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183630336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788638504.678827:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788638504.678870:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183630336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638504.678877:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1788638504.678917:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b4659f80 x1875523183630336/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638520 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638504.678935:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4659f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183630336:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788638504.863957:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788638505.254416:0:11485:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 16:01:43 (1788638503) === 00000100:00100000:0.0:1788638505.444030:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638505.444075:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638505.444133:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174154624 00000100:00100000:1.0:1788638505.444143:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174154624 00000100:00100000:1.0:1788638505.444214:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 14 00000100:00100000:1.0:1788638505.444224:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174154624:12345-192.168.203.34@tcp:41:mkdir.0 00000004:00000024:1.0:1788638505.444270:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788638505.444355:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174154624:12345-192.168.203.34@tcp:41:mkdir.0 Request processed in 133us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638505.444362:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 14 00000100:00080000:0.0:1788638505.445296:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638505.445738:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174154752 00000100:00100000:3.0:1788638505.445746:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174154752 00000100:00100000:3.0:1788638505.445900:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 0 00000100:00100000:3.0:1788638505.445911:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:9702:x1875523174154752:12345-192.168.203.34@tcp:700:mkdir.0 00000100:00100000:3.0:1788638505.445989:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:9702:x1875523174154752:12345-192.168.203.34@tcp:700:mkdir.0 Request processed in 79us (1911us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638505.445997:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 0 00000100:00100000:0.0:1788638505.450484:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638505.450729:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174155008 00000100:00100000:3.0:1788638505.450739:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174155008 00000100:00100000:3.0:1788638505.450836:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 15 00000100:00100000:3.0:1788638505.450846:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+6:9702:x1875523174155008:12345-192.168.203.34@tcp:36:mkdir.0 00010000:00010000:3.0:1788638505.450906:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638505.450933:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73829f1a00/0xa0b1f1e3b4b2a7f0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d20 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.450948:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7393e81200) 00010000:00010000:3.0:1788638505.450958:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788638505.451276:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2a90f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.451290:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2a90f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.451299:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2a90f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.451354:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2a916 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.451362:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2a916 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.451369:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2a916 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638505.452871:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788638505.452886:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2a90f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.452895:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2a90f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.452909:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2a90f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.452916:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638505.452920:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2a90f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.452928:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2a90f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.452942:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7393e81000) 00010000:00010000:3.0:1788638505.452945:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638505.452949:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2a90f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.452956:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2a90f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788638505.452975:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b2f5c8b reply state 00000000725315e8 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2a916 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638505.452984:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788638505.453092:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+7:9702:x1875523174155008:12345-192.168.203.34@tcp:36:mkdir.0 Request processed in 2244us (2613us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788638505.453101:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 15 00010000:00010000:3.0:1788638505.464143:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2a916 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.464160:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2a916 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.464185:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2a916 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.464190:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638505.464195:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2a916 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.464204:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2a916 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.464223:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c7393e81100) 00010000:00010000:3.0:1788638505.464227:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638505.464232:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2a916 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.464238:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2a916 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638505.467317:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638505.467360:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174155136 00000100:00100000:3.0:1788638505.467369:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174155136 00000100:00100000:3.0:1788638505.467421:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 16 00000100:00100000:3.0:1788638505.467431:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:9703:x1875523174155136:12345-192.168.203.34@tcp:101:chmod.0 00010000:00010000:3.0:1788638505.467452:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638505.467474:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a91d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434da5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.467550:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031200/0xa0b1f1e3b4b2a924 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.467592:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031200/0xa0b1f1e3b4b2a924 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.467604:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031200/0xa0b1f1e3b4b2a924 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638505.467645:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788638505.467649:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788638505.467690:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031200/0xa0b1f1e3b4b2a924 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.467722:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a91d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434da5 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.467740:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031200/0xa0b1f1e3b4b2a924 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434da5 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.467748:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:3.0:1788638505.467751:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788638505.467755:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031200, rc 0) 00000100:00100000:3.0:1788638505.467945:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+7:9703:x1875523174155136:12345-192.168.203.34@tcp:101:chmod.0 Request processed in 515us (636us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638505.467952:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 16 00000100:00100000:0.0:1788638505.477141:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638505.478140:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174155392 00000100:00100000:2.0:1788638505.478153:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174155392 00000100:00100000:2.0:1788638505.478225:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 17 00000100:00100000:2.0:1788638505.478236:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+7:9703:x1875523174155392:12345-192.168.203.34@tcp:36:chmod.0 00010000:00010000:2.0:1788638505.478296:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638505.478324:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031200/0xa0b1f1e3b4b2a924 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434da5 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.478343:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:2.0:1788638505.478365:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788638505.478394:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a92b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.478406:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a92b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.478416:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a92b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788638505.478756:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d5ccb170 reply state 000000009c881937 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a92b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638505.478767:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788638505.478777:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788638505.478903:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+8:9703:x1875523174155392:12345-192.168.203.34@tcp:36:chmod.0 Request processed in 668us (1770us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1788638505.478910:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 17 00010000:00010000:3.0:1788638505.487467:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a92b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.487487:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a92b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.487505:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a92b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.487511:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638505.487515:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a92b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.487523:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a92b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.487549:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c738a6e9300) 00010000:00010000:3.0:1788638505.487553:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788638505.487558:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a92b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.487566:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2a92b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638505.505562:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638505.505706:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174155520 00000100:00100000:3.0:1788638505.505717:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174155520 00000100:00100000:3.0:1788638505.505810:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 18 00000100:00100000:3.0:1788638505.505864:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+7:9704:x1875523174155520:12345-192.168.203.34@tcp:101:chown.0 00010000:00010000:3.0:1788638505.505888:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638505.505915:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a932 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434dac expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.505989:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2a939 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.506003:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2a939 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.506035:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2a939 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638505.506077:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788638505.506081:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788638505.506119:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2a939 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.506146:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a932 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434dac expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.506164:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2a939 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434dac expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.506173:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7393e81100) 00010000:00010000:3.0:1788638505.506176:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788638505.506180:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031400, rc 0) 00000100:00100000:3.0:1788638505.506323:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+8:9704:x1875523174155520:12345-192.168.203.34@tcp:101:chown.0 Request processed in 504us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638505.506331:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 18 00000100:00100000:0.0:1788638505.513832:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638505.513959:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174155648 00000100:00100000:2.0:1788638505.513970:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174155648 00000100:00100000:2.0:1788638505.514028:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 19 00000100:00100000:2.0:1788638505.514039:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+8:9704:x1875523174155648:12345-192.168.203.34@tcp:101:chown.0 00010000:00010000:2.0:1788638505.514062:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638505.514083:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2a940 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434db3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514158:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a947 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514172:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a947 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514195:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a947 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514210:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a94e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514217:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a94e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514222:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a94e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514314:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a955 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514322:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a955 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514328:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a955 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638505.514368:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788638505.514372:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788638505.514396:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a955 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514409:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a947 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514415:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a947 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514430:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a947 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514435:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638505.514439:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a947 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514447:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a947 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514460:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7393e81100) 00010000:00010000:2.0:1788638505.514463:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638505.514468:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a947 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514475:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a947 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514497:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a94e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514504:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a94e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514509:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a94e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514514:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638505.514516:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a94e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514532:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a94e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514541:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c738a6e9b00) 00010000:00010000:2.0:1788638505.514544:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638505.514546:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a94e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514552:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2a94e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514633:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2a940 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434db3 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514649:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a955 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434db3 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.514656:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c738a6e9300) 00010000:00010000:2.0:1788638505.514658:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788638505.514661:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6400, rc 0) 00000100:00100000:2.0:1788638505.514730:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+9:9704:x1875523174155648:12345-192.168.203.34@tcp:101:chown.0 Request processed in 694us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638505.514737:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 19 00000100:00100000:0.0:1788638505.520879:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638505.520976:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174155904 00000100:00100000:3.0:1788638505.520986:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174155904 00000100:00100000:3.0:1788638505.521046:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 20 00000100:00100000:3.0:1788638505.521056:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+9:9704:x1875523174155904:12345-192.168.203.34@tcp:36:chown.0 00010000:00010000:3.0:1788638505.521112:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638505.521138:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2a955 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434db3 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.521174:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c738a6e9300) 00010000:00010000:3.0:1788638505.521197:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788638505.521227:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a95c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.521239:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a95c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.521250:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a95c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788638505.567705:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:1.0:1788638505.567724:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1788638505.567840:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bfbded71 reply state 00000000e972465c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a95c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638505.567854:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788638505.567871:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1788638505.567972:0:5842:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788638505.567988:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+7:9704:x1875523174155904:12345-192.168.203.34@tcp:36:chown.0 Request processed in 46929us (47114us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788638505.567997:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 20 00010000:00010000:3.0:1788638505.569336:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a95c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.569353:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a95c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.569361:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a95c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.569368:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638505.569373:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a95c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.569382:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a95c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.569398:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c7393e81000) 00010000:00010000:3.0:1788638505.569401:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788638505.569406:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a95c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.569429:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a95c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638505.597097:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638505.597754:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174156032 00000100:00100000:2.0:1788638505.597766:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174156032 00000100:00100000:2.0:1788638505.597858:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 21 00000100:00100000:2.0:1788638505.597867:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+6:9705:x1875523174156032:12345-192.168.203.34@tcp:101:touch.500 00010000:00010000:2.0:1788638505.597889:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638505.597920:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2a963 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434dba expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788638505.603595:0:5843:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5621us 00010000:00010000:3.0:1788638505.611587:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a96a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.611609:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a96a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.611622:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a96a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.611641:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2a971 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.611649:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2a971 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.611656:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2a971 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.612927:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c000/0xa0b1f1e3b4b2a978 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.612941:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c000/0xa0b1f1e3b4b2a978 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.612951:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c000/0xa0b1f1e3b4b2a978 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638505.612984:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788638505.612989:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638505.613039:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c000/0xa0b1f1e3b4b2a978 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.613054:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a96a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.613062:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a96a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.613069:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a96a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.613074:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638505.613078:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a96a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.613086:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a96a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.613098:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7393e81100) 00010000:00010000:0.0:1788638505.613101:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638505.613105:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a96a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.613111:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2a96a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.613123:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2a971 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.613130:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2a971 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.613145:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2a971 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.613149:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638505.613152:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2a971 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.613159:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2a971 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.613167:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c7393e81000) 00010000:00010000:0.0:1788638505.613170:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638505.613172:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2a971 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.613177:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2a971 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.613221:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2a963 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434dba expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.613236:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c000/0xa0b1f1e3b4b2a978 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434dba expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.613243:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:0.0:1788638505.613245:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788638505.613247:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01c000, rc 0) 00000100:00100000:0.0:1788638505.613317:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+7:9705:x1875523174156032:12345-192.168.203.34@tcp:101:touch.500 Request processed in 15450us (16227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638505.613335:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 21 00000100:00100000:0.0:1788638505.618751:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638505.618947:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174156288 00000100:00100000:1.0:1788638505.618958:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174156288 00000100:00100000:1.0:1788638505.619017:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 22 00000100:00100000:1.0:1788638505.619027:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+7:9705:x1875523174156288:12345-192.168.203.34@tcp:101:touch.500 00010000:00010000:1.0:1788638505.619047:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638505.619069:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2a97f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434dc1 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638505.619363:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2a986 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638505.619380:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2a986 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638505.619394:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2a986 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638505.619472:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2a98d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638505.619481:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2a98d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638505.619488:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2a98d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788638505.620740:0:7634:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1788638505.621314:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2a994 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638505.621330:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2a994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638505.621339:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2a994 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638505.621386:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2a986 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638505.621394:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2a986 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638505.621400:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2a986 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638505.621405:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638505.621410:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2a986 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638505.621429:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2a986 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638505.621443:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:1.0:1788638505.621445:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638505.621449:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2a986 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638505.621455:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2a986 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788638505.621467:0:7634:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009bedb087 reply state 000000000c03384d transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2a98d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638505.621476:0:7634:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788638505.621520:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2a97f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434dc1 expref: 10 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638505.621535:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2a994 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434dc1 expref: 9 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638505.621556:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c7398420000) 00010000:00010000:1.0:1788638505.621558:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788638505.621561:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309000, rc 0) 00000100:00100000:1.0:1788638505.621645:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c2b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+10:9705:x1875523174156288:12345-192.168.203.34@tcp:101:touch.500 Request processed in 2619us (2912us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788638505.621653:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 22 00010000:00010000:0.0:1788638505.623774:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2a98d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.623811:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2a98d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.623819:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2a98d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.623825:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638505.623829:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2a98d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.623837:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2a98d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.623859:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x60d7aa11 (ffff9c7398420d00) 00010000:00010000:0.0:1788638505.623862:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638505.623867:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2a98d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.623873:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2a98d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638505.626920:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638505.627177:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174156544 00000100:00100000:3.0:1788638505.627186:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174156544 00000100:00100000:3.0:1788638505.627249:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 23 00000100:00100000:3.0:1788638505.627259:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+9:9705:x1875523174156544:12345-192.168.203.34@tcp:36:touch.500 00010000:00010000:3.0:1788638505.627321:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638505.627351:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2a994 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434dc1 expref: 9 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.627369:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c7398420000) 00010000:00010000:3.0:1788638505.627388:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788638505.627436:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2a9a2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.627450:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2a9a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.627460:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2a9a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788638505.627617:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002828c15a reply state 0000000021599b29 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2a9a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638505.627626:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788638505.627720:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+10:9705:x1875523174156544:12345-192.168.203.34@tcp:36:touch.500 Request processed in 461us (808us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788638505.627726:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 23 00010000:00010000:0.0:1788638505.630660:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2a9a2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.630676:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2a9a2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.630696:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2a9a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.630702:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638505.630706:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2a9a2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.630715:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2a9a2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.630738:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c7393e81200) 00010000:00010000:0.0:1788638505.630742:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638505.630746:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2a9a2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.630753:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2a9a2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638505.631881:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638505.632533:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174156672 00000100:00100000:3.0:1788638505.632553:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174156672 00000100:00100000:3.0:1788638505.632622:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 24 00000100:00100000:3.0:1788638505.632632:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+9:9705:x1875523174156672:12345-192.168.203.34@tcp:101:touch.500 00010000:00010000:3.0:1788638505.632657:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638505.632677:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2a9a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434dc8 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.632752:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2a9a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434dc8 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.632767:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2a9a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434dc8 expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.632825:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c7393e81b00) 00010000:00010000:3.0:1788638505.632829:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788638505.632832:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031a00, rc 0) 00000100:00100000:3.0:1788638505.632879:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+10:9705:x1875523174156672:12345-192.168.203.34@tcp:101:touch.500 Request processed in 249us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638505.632887:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 24 00000100:00100000:0.0:1788638505.637067:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638505.637164:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174156800 00000100:00100000:1.0:1788638505.637187:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174156800 00000100:00100000:1.0:1788638505.637234:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 16 00000100:00100000:1.0:1788638505.637242:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2363:x1875523174156800:12345-192.168.203.34@tcp:8:touch.500 00010000:00080000:1.0:1788638505.637275:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:1.0:1788638505.637303:0:6687:0:(genops.c:1385:class_connect()) connect: client 00196f64-ae55-4ffc-b84c-468028ab3a77, cookie 0xa0b1f1e3b4b2a9b0 00002000:00100000:1.0:1788638505.637316:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 00196f64-ae55-4ffc-b84c-468028ab3a77/ffff9c73ad6ee000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788638505.637326:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:1.0:1788638505.637557:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788638505.637595:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9c73ad6eb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788638505.642026:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2363:x1875523174156800:12345-192.168.203.34@tcp:8:touch.500 Request processed in 4772us (4956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638505.642040:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 16 00000100:00100000:0.0:1788638505.644930:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638505.645012:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174156928 00000100:00100000:3.0:1788638505.645021:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174156928 00000100:00100000:3.0:1788638505.645088:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 17 00000100:00100000:3.0:1788638505.645098:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+6:0:x1875523174156928:12345-192.168.203.34@tcp:2:touch.500 00000100:00080000:0.0:1788638505.645388:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1788638505.669009:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 00196f64-ae55-4ffc-b84c-468028ab3a77 00000001:00080000:3.0:1788638505.669026:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1788638505.669183:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+5:0:x1875523174156928:12345-192.168.203.34@tcp:2:touch.500 Request processed in 24081us (24255us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1788638505.669194:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 17 00000100:00100000:3.0:1788638505.673742:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638505.673972:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174157184 00000100:00100000:0.0:1788638505.673982:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174157184 00000100:00100000:0.0:1788638505.674045:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 2 00000100:00100000:0.0:1788638505.674056:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+10:9705:x1875523174157184:12345-192.168.203.34@tcp:35:touch.500 00000100:00100000:0.0:1788638505.674614:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+11:9705:x1875523174157184:12345-192.168.203.34@tcp:35:touch.500 Request processed in 558us (879us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788638505.674623:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 2 00000100:00100000:0.0:1788638505.693731:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638505.693979:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174157312 00000100:00100000:3.0:1788638505.693990:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174157312 00000100:00100000:2.0:1788638505.694107:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 25 00000100:00100000:2.0:1788638505.694120:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+11:9706:x1875523174157312:12345-192.168.203.34@tcp:101:rm.0 00010000:00010000:2.0:1788638505.694145:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638505.694271:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2a9b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434dcf expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.694355:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2a9be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.694556:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2a9be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.694572:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2a9be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638505.694626:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788638505.694631:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788638505.694671:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2a9be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.694700:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2a9b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434dcf expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.694737:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2a9be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434dcf expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.694745:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:2.0:1788638505.694748:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788638505.694752:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6000, rc 0) 00000100:00100000:2.0:1788638505.694855:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+12:9706:x1875523174157312:12345-192.168.203.34@tcp:101:rm.0 Request processed in 738us (1133us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638505.694862:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 25 00000100:00100000:2.0:1788638505.702099:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638505.702360:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174157568 00000100:00100000:3.0:1788638505.702371:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174157568 00000100:00100000:3.0:1788638505.702429:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 26 00000100:00100000:3.0:1788638505.702440:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+12:9706:x1875523174157568:12345-192.168.203.34@tcp:101:rm.0 00010000:00010000:3.0:1788638505.702461:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638505.702482:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2a9c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434dd6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638505.702726:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788638505.703055:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2a9c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434dd6 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.703082:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7393e81100) 00010000:00010000:3.0:1788638505.703085:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788638505.703091:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2a9c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434dd6 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.703105:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030e00, rc 0) 00000100:00100000:3.0:1788638505.703400:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4659f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+13:9706:x1875523174157568:12345-192.168.203.34@tcp:101:rm.0 Request processed in 960us (1308us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1788638505.703408:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 26 00000100:00100000:0.0:1788638505.716878:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638505.716961:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174157696 00000100:00100000:3.0:1788638505.716971:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174157696 00000100:00100000:3.0:1788638505.717025:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 3 00000100:00100000:3.0:1788638505.717036:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+13:9706:x1875523174157696:12345-192.168.203.34@tcp:37:rm.0 00000100:00100000:2.0:1788638505.721929:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+13:9706:x1875523174157696:12345-192.168.203.34@tcp:37:rm.0 Request processed in 4494us (4660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638505.721948:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 3 00000100:00100000:2.0:1788638505.726110:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638505.733393:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174157952 00000100:00100000:0.0:1788638505.733407:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174157952 00000100:00100000:0.0:1788638505.733477:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 4 00000100:00100000:0.0:1788638505.733487:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73a575a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+13:9706:x1875523174157952:12345-192.168.203.34@tcp:35:rm.0 00000100:00100000:0.0:1788638505.733763:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73a575a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+14:9706:x1875523174157952:12345-192.168.203.34@tcp:35:rm.0 Request processed in 277us (7660us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788638505.733772:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 4 00000100:00100000:0.0:1788638505.739993:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638505.740107:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174158208 00000100:00100000:2.0:1788638505.740117:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174158208 00000100:00100000:2.0:1788638505.740488:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 27 00000100:00100000:2.0:1788638505.740501:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+14:9706:x1875523174158208:12345-192.168.203.34@tcp:101:rm.0 00010000:00010000:2.0:1788638505.740526:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638505.740557:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2a9d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434ddd expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.740681:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a9da lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.740697:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a9da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.740723:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a9da lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638505.741023:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788638505.741179:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2a9d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ddd expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.741199:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a9da lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ddd expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.741217:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:2.0:1788638505.741293:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788638505.741298:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6800, rc 0) 00000100:00100000:2.0:1788638505.741437:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+16:9706:x1875523174158208:12345-192.168.203.34@tcp:101:rm.0 Request processed in 938us (1452us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788638505.741444:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 27 00000100:00100000:3.0:1788638505.745978:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638505.746452:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174158336 00000100:00100000:0.0:1788638505.746462:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174158336 00000100:00100000:0.0:1788638505.746524:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 28 00000100:00100000:0.0:1788638505.746535:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+16:9706:x1875523174158336:12345-192.168.203.34@tcp:41:rm.0 00000004:00000024:0.0:1788638505.746619:0:7634:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1788638505.746702:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+16:9706:x1875523174158336:12345-192.168.203.34@tcp:41:rm.0 Request processed in 168us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638505.746714:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 28 00000100:00100000:3.0:1788638505.749942:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638505.752166:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174158464 00000100:00100000:0.0:1788638505.752182:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174158464 00000100:00100000:0.0:1788638505.752356:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 29 00000100:00100000:0.0:1788638505.752366:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+16:9706:x1875523174158464:12345-192.168.203.34@tcp:101:rm.0 00010000:00010000:0.0:1788638505.752386:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638505.752407:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2a9e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434de4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.752474:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2a9ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.752501:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2a9ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.752513:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2a9ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.752528:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2a9f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.752535:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2a9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.752667:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2a9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.752848:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2a9fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.752856:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2a9fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.752863:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2a9fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638505.752894:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788638505.752898:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638505.752918:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2a9fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.752930:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2a9fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.752948:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2a9ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.752954:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2a9ef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.752960:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2a9ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.752964:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638505.752969:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2a9ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.752976:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2a9ef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.752987:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:0.0:1788638505.752989:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638505.752994:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2a9ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.752999:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2a9ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.753012:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2a9f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.753018:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2a9f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.753023:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2a9f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.753032:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01da00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638505.753035:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2a9f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.753040:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2a9f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.753047:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x60d7aa11 (ffff9c73a1cf7c00) 00010000:00010000:0.0:1788638505.753049:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638505.753051:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2a9f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.753056:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2a9f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.753090:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2a9e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434de4 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.753102:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2a9fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434de4 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.753109:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c7393e81b00) 00010000:00010000:0.0:1788638505.753111:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788638505.753113:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01d200, rc 0) 00000100:00100000:0.0:1788638505.753183:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+17:9706:x1875523174158464:12345-192.168.203.34@tcp:101:rm.0 Request processed in 818us (3249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638505.753191:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 29 00000100:00100000:1.0:1788638505.763489:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638505.764623:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174158720 00000100:00100000:0.0:1788638505.764655:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174158720 00000100:00100000:0.0:1788638505.764728:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 30 00000100:00100000:0.0:1788638505.764739:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+17:9706:x1875523174158720:12345-192.168.203.34@tcp:36:rm.0 00010000:00010000:0.0:1788638505.764811:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788638505.764840:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2a9fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434de4 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.764858:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2a9a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434dc8 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.764869:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c7393e81b00) 00010000:00010000:0.0:1788638505.764884:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2a9be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434dcf expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.764892:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:0.0:1788638505.764895:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788638505.764916:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aa04 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.764928:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aa04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.764937:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aa04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.764949:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2aa0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.764956:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2aa0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.764973:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2aa0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.765113:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2aa12 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.765121:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2aa12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.765129:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2aa12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788638505.765918:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1788638505.765930:0:7634:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 268837145862ns, next at 269837143251ns, rc = 0 00010000:00010000:0.0:1788638505.765992:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2aa19 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.766002:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2aa19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.766012:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2aa19 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.766020:0:7634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2aa19 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.766026:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2aa19 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.766033:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2aa19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.766072:0:7634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638505.766095:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2aa12 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.766101:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2aa12 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.766107:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2aa12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.766112:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638505.766117:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2aa12 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.766123:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2aa12 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.766133:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c73a1cf7900) 00010000:00010000:0.0:1788638505.766136:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788638505.766140:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2aa12 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.766146:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2aa12 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.766161:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aa04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.766166:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aa04 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.766171:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aa04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.766184:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638505.766187:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aa04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.766193:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aa04 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.766201:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:0.0:1788638505.766203:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638505.766205:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aa04 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.766211:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aa04 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788638505.766220:0:7634:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fbc09c64 reply state 00000000d8f72dde transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2aa0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638505.766229:0:7634:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788638505.766322:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+16:9706:x1875523174158720:12345-192.168.203.34@tcp:36:rm.0 Request processed in 1582us (2838us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788638505.766330:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 30 00010000:00010000:3.0:1788638505.767291:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638505.767301:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2aa19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.767311:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01ce00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638505.767315:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2aa19 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.767323:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2aa19 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.767336:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9c73a1cf7900) 00010000:00010000:3.0:1788638505.767350:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788638505.767356:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2aa19 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.767361:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2aa19 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.767380:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638505.767382:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638505.767384:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638505.770741:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2aa0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.770759:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2aa0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.770768:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2aa0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.770847:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01da00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638505.770852:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2aa0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.770859:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2aa0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.770875:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x60d7aa11 (ffff9c73a1cf7c00) 00010000:00010000:0.0:1788638505.770878:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638505.770882:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2aa0b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.770889:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2aa0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x60d7aa11 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638505.774356:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638505.775105:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174158976 00000100:00100000:0.0:1788638505.775115:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174158976 00000100:00100000:0.0:1788638505.775180:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 5 00000100:00100000:0.0:1788638505.775191:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+15:9706:x1875523174158976:12345-192.168.203.34@tcp:35:rm.0 00000100:00100000:0.0:1788638505.775467:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+16:9706:x1875523174158976:12345-192.168.203.34@tcp:35:rm.0 Request processed in 278us (1118us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788638505.775474:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 5 00000100:00100000:3.0:1788638505.777892:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638505.777993:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174159232 00000100:00100000:2.0:1788638505.778003:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174159232 00000100:00100000:2.0:1788638505.778061:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 31 00000100:00100000:2.0:1788638505.778072:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+16:9706:x1875523174159232:12345-192.168.203.34@tcp:36:rm.0 00010000:00010000:2.0:1788638505.778132:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1788638505.778161:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6800/0xa0b1f1e3b4b2a9da lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ddd expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.778184:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c000/0xa0b1f1e3b4b2a978 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434dba expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.778216:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:2.0:1788638505.778249:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2a939 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434dac expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.778259:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7393e81100) 00010000:00010000:2.0:1788638505.778266:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788638505.778292:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2aa20 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.778305:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2aa20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.778315:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2aa20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.778328:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2aa27 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.778335:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2aa27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.778341:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2aa27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.778612:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2aa2e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.778622:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2aa2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.778640:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2aa2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638505.780060:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788638505.780080:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2aa2e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.780090:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2aa2e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.780097:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2aa2e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.780104:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638505.780108:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2aa2e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.780116:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2aa2e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.780128:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9c738a6e9a00) 00010000:00010000:2.0:1788638505.780131:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788638505.780135:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2aa2e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.780141:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2aa2e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.780164:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2aa20 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.780170:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2aa20 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.780182:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2aa20 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.780187:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638505.780189:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2aa20 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.780195:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2aa20 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.780202:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c738a6e9b00) 00010000:00010000:2.0:1788638505.780205:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638505.780207:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2aa20 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638505.780212:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2aa20 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788638505.780224:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000058f2b7e7 reply state 00000000af809701 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2aa27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638505.780232:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788638505.780326:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+15:9706:x1875523174159232:12345-192.168.203.34@tcp:36:rm.0 Request processed in 2253us (2441us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788638505.780336:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 31 00010000:00010000:0.0:1788638505.781610:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2aa27 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.781624:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2aa27 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.781631:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2aa27 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.781647:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638505.781651:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2aa27 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.781657:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2aa27 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.781670:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9c738a6e9100) 00010000:00010000:0.0:1788638505.781672:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638505.781675:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2aa27 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638505.781682:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2aa27 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638505.887983:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638506.912954:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638507.232613:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638507.232639:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183630464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788638507.232712:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638507.232883:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183630464 00000100:00100000:2.0:1788638507.232891:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183630464 00000100:00100000:2.0:1788638507.232946:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788638507.232955:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183630464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788638507.232999:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788638507.233043:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183630464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638507.233050:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:2.0:1788638507.233089:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b4658a80 x1875523183630464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638523 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638507.233105:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183630464:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788638507.233289:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788638507.266873:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638507.266914:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638507.266943:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638507.266943:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174159360 00000100:00100000:1.0:1788638507.266954:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174159360 00000100:00100000:3.0:1788638507.266977:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638507.267002:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 251 00000100:00100000:1.0:1788638507.267012:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+13:2367:x1875523174159360:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638507.267089:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386790050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+13:2367:x1875523174159360:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 78us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638507.267096:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 251 00000100:00100000:2.0:1788638507.267180:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174159488 00000100:00100000:2.0:1788638507.267185:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174159488 00000100:00100000:2.0:1788638507.267234:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174159744 00000100:00100000:2.0:1788638507.267237:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174159744 00000100:00100000:2.0:1788638507.267257:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 105 00000100:00100000:2.0:1788638507.267264:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+14:2367:x1875523174159488:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638507.267310:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+14:2367:x1875523174159488:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 47us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638507.267317:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 105 00000100:00100000:2.0:1788638507.267331:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 106 00000100:00100000:2.0:1788638507.267337:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2367:x1875523174159744:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638507.267364:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2367:x1875523174159744:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 27us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638507.267370:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 106 00000100:00080000:1.0:1788638507.267433:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638507.267483:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174159616 00000100:00100000:0.0:1788638507.267488:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174159616 00000100:00100000:0.0:1788638507.267536:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 59 00000100:00100000:0.0:1788638507.267544:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2367:x1875523174159616:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638507.267590:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2367:x1875523174159616:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 48us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638507.267597:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 59 00000100:00080000:1.0:1788638507.267665:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788638507.943520:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638508.960178:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638509.280297:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183630720:0@lo:400:kworker.0 00000100:00100000:3.0:1788638509.280398:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638509.280475:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183631232:0@lo:400:kworker.0 00000100:00100000:3.0:1788638509.280505:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638509.280538:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788638509.280545:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183630592:0@lo:400:kworker.0 00000100:00100000:3.0:1788638509.280589:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638509.280614:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183631104:0@lo:400:kworker.0 00000100:00100000:3.0:1788638509.280635:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638509.280664:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183630976:0@lo:400:kworker.0 00000100:00100000:3.0:1788638509.280741:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638509.280762:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788638509.280767:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183630848:0@lo:400:kworker.0 00000100:00100000:3.0:1788638509.280831:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638509.280865:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183630592 00000100:00100000:3.0:1788638509.280875:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183630592 00000100:00100000:3.0:1788638509.281064:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788638509.281077:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183630592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638509.281138:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386791050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183630592:12345-0@lo:400:kworker.0 Request processed in 65us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638509.281147:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1788638509.281189:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183630720 00000100:00100000:3.0:1788638509.281192:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183630720 00000100:00100000:3.0:1788638509.281214:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183631104 00000100:00100000:3.0:1788638509.281216:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183631104 00000100:00100000:3.0:1788638509.281238:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183630848 00000100:00100000:3.0:1788638509.281241:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183630848 00000100:00100000:3.0:1788638509.281257:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788638509.281262:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183630720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638509.281296:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183630720:12345-0@lo:400:kworker.0 Request processed in 33us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638509.281302:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788638509.281314:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788638509.281319:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183631104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638509.281346:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183631104:12345-0@lo:400:kworker.0 Request processed in 27us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638509.281352:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788638509.281373:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788638509.281378:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183630848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638509.281413:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183630848:12345-0@lo:400:kworker.0 Request processed in 34us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638509.281419:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788638509.281462:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183630848:0@lo:400:kworker.0 00000100:00100000:3.0:1788638509.281496:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183630592:0@lo:400:kworker.0 00000100:00100000:3.0:1788638509.281507:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183631104:0@lo:400:kworker.0 00000100:00100000:3.0:1788638509.281516:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183630720:0@lo:400:kworker.0 00000100:00100000:2.0:1788638509.281636:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183631232 00000100:00100000:2.0:1788638509.281641:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183631232 00000100:00100000:2.0:1788638509.281682:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183630976 00000100:00100000:2.0:1788638509.281686:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183630976 00000100:00100000:2.0:1788638509.281721:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788638509.281728:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183631232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638509.281774:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183631232:12345-0@lo:400:kworker.0 Request processed in 47us (1269us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638509.281805:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788638509.281821:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788638509.281827:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183630976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638509.281861:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183630976:12345-0@lo:400:kworker.0 Request processed in 34us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638509.281867:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1788638509.281899:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73ad30f100 x1875523183631232/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638509.281911:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183631232:0@lo:400:kworker.0 00000100:00080000:1.0:1788638509.282134:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788638509.282139:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788638509.282142:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788638509.283015:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73ad30df80 x1875523183630976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638509.283031:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183630976:0@lo:400:kworker.0 00000100:00100000:3.0:1788638509.792039:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:2.0:1788638509.792282:0:7957:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 272863498074ns, next at 273863495008ns, rc = 0 00000100:00100000:3.0:1788638509.792380:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183631360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788638509.792486:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638509.792629:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183631360 00000100:00100000:2.0:1788638509.792639:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183631360 00000100:00100000:2.0:1788638509.792720:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788638509.792731:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183631360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788638509.792777:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788638509.792871:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183631360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638509.792879:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1788638509.795489:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b4658a80 x1875523183631360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638525 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638509.795572:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4658a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183631360:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788638509.985196:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788638510.433760:0:11637:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:2.0:1788638510.934886:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:2.0:1788638510.934907:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:2.0:1788638510.934941:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:2.0:1788638510.934947:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1788638510.935221:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638510.935247:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183631488:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788638510.935348:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638510.935430:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183631488 00000100:00100000:0.0:1788638510.935444:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183631488 00000100:00100000:0.0:1788638510.935504:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788638510.935514:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183631488:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788638510.935560:0:6686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1788638510.935602:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9c7529, atime: 0x6a9c7529, ctime: 0x6a9c7529, blocks: 0x1 00010000:00010000:0.0:1788638510.935611:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2aa35 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638510.935631:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=274s v=(0 0) 00010000:00010000:0.0:1788638510.935636:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638510.935644:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2aa35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638510.935666:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2aa35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638510.935678:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2aa35 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638510.935686:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2aa35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638510.935717:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788638510.936352:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3291:x1875523183631488:12345-0@lo:6:osp-syn-1-0.0 Request processed in 837us (1002us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788638510.936362:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788638510.936399:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638510.936407:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2aa35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638510.936417:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c200 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638510.936423:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2aa35 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638510.936435:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2aa35 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638510.936455:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2aa35 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638510.936463:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2aa35 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638510.936485:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638510.936487:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638510.936489:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788638510.936528:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c73b7c44700/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788638510.936535:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183631488:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788638511.008119:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788638511.742714:0:11687:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe0b98e2c0 20000000:00000080:1.0:1788638511.742731:0:11687:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c73bf6e9800 uarg=0000000000000000 20000000:01000000:1.0:1788638511.742765:0:11687:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788638511.742771:0:11687:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1788638511.742776:0:11687:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788638511.744561:0:11688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1788638511.744701:0:11687:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1788638511.753204:0:11687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1788638511.753270:0:11687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1788638511.753333:0:11687:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1788638511.753351:0:11687:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788638511.753371:0:11687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa3c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638511.753392:0:11687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c73bc01d000/0xa0b1f1e3b4b2a8d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d97 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638511.753399:0:11687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a8de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d9e expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638511.753408:0:11687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a8ec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a8e5 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638511.753416:0:11687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2a8fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a8f3 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638511.753424:0:11687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2a908 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a901 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638511.753431:0:11687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa3c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638511.753483:0:11687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2a908 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a901 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638511.753509:0:11687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2a908 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a901 expref: 18 pid: 5835 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638511.753524:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11687:1875523183631616:0@lo:104: 00000100:00100000:1.0:1788638511.753596:0:11687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788638511.753656:0:11687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2a8fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a8f3 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638511.753665:0:11687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2a8fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a8f3 expref: 18 pid: 5835 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638511.753673:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11687:1875523183631744:0@lo:104: 00000100:00100000:1.0:1788638511.753697:0:11687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788638511.753731:0:11687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a8ec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a8e5 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638511.753740:0:11687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a8ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a8e5 expref: 18 pid: 5835 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638511.753749:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11687:1875523183631872:0@lo:104: 00000100:00100000:1.0:1788638511.753776:0:11687:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788638511.753820:0:11687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a8de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d9e expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638511.753831:0:11687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a8de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d9e expref: 12 pid: 5837 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638511.753853:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11687:1875523183632000:192.168.203.34@tcp:104: 00010000:00010000:1.0:1788638511.753905:0:11687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c73bc01d000/0xa0b1f1e3b4b2a8d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d97 expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638511.753914:0:11687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c73bc01d000/0xa0b1f1e3b4b2a8d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d97 expref: 12 pid: 5835 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638511.753923:0:11687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11687:1875523183632128:192.168.203.34@tcp:104: 00000100:00100000:1.0:1788638511.753946:0:11687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387cf1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788638511.754129:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788638511.754143:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183631616 00000100:00100000:0.0:1788638511.754150:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183631616 00000100:00100000:0.0:1788638511.754186:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183631744 00000100:00100000:0.0:1788638511.754190:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183631744 00000100:00100000:0.0:1788638511.754202:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183631872 00000100:00100000:0.0:1788638511.754204:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183631872 00000100:00100000:0.0:1788638511.754218:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788638511.754226:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+5:11687:x1875523183631616:12345-0@lo:104: 00010000:00010000:0.0:1788638511.754240:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c73bc01de00/0xa0b1f1e3b4b2a901 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a908 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.754302:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788638511.754308:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+5:11687:x1875523183631616:12345-0@lo:104: Request processed in 83us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638511.754317:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788638511.754333:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788638511.754340:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+4:11687:x1875523183631744:12345-0@lo:104: 00010000:00010000:0.0:1788638511.754348:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a8f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a8fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.754379:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788638511.754384:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+4:11687:x1875523183631744:12345-0@lo:104: Request processed in 46us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638511.754391:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788638511.754403:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788638511.754409:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad46b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:11687:x1875523183631872:12345-0@lo:104: 00010000:00010000:0.0:1788638511.754423:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a8e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a8ec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.754472:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788638511.754478:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad46b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+3:11687:x1875523183631872:12345-0@lo:104: Request processed in 69us (702us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638511.754484:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788638511.754520:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788638511.754527:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c73bc01de00/0xa0b1f1e3b4b2a901 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a908 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.754534:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01de00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:0.0:1788638511.754548:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c73bc01de00/0xa0b1f1e3b4b2a901 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a908 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.754557:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c73bc01de00/0xa0b1f1e3b4b2a901 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a908 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638511.754565:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c73bc01de00/0xa0b1f1e3b4b2a901 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a908 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638511.754570:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788638511.754596:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c73bc01de00/0xa0b1f1e3b4b2a901 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a908 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.754603:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788638511.754624:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c73bc01de00/0xa0b1f1e3b4b2a901 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a908 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.754631:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c73bc01de00/0xa0b1f1e3b4b2a901 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a908 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.754650:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788638511.754653:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a8f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a8fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.754659:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030400 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:0.0:1788638511.754662:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a8f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a8fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.754669:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a8f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a8fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638511.754675:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a8f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a8fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638511.754680:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788638511.754694:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a8f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a8fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.754700:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788638511.754707:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a8f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a8fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.754714:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7380030400/0xa0b1f1e3b4b2a8f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a8fa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.754724:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638511.754728:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a8e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2a8ec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.754745:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7000 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:0.0:1788638511.754748:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a8e5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2a8ec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.754756:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a8e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2a8ec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638511.754763:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a8e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2a8ec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638511.754768:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788638511.754806:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a8e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a8ec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.754813:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788638511.754829:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a8e5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a8ec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.754836:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2a8e5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2a8ec expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.754850:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638511.754852:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638511.754853:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638511.754860:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638511.754865:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638511.754876:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183632256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788638511.754908:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638511.754939:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788638511.754953:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183632384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788638511.754978:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638511.755000:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183632512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788638511.755037:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638511.755067:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183632256 00000100:00100000:0.0:1788638511.755072:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183632256 00010000:00010000:0.0:1788638511.755092:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2a908 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a901 expref: 19 pid: 5835 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638511.755107:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183632384 00000100:00100000:0.0:1788638511.755109:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183632384 00010000:00010000:0.0:1788638511.755121:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2a8fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a8f3 expref: 20 pid: 5835 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638511.755132:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183632512 00000100:00100000:0.0:1788638511.755134:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183632512 00010000:00010000:0.0:1788638511.755145:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a8ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a8e5 expref: 21 pid: 5835 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638511.755157:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788638511.755164:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+21:3293:x1875523183632256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788638511.755174:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638511.755179:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2a908 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a901 expref: 21 pid: 5835 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.755191:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2a908 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a901 expref: 21 pid: 5835 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.755208:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638511.755235:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+21:3293:x1875523183632256:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638511.755247:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788638511.755261:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788638511.755268:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+20:3293:x1875523183632384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788638511.755277:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638511.755282:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2a8fa lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a8f3 expref: 20 pid: 5835 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.755290:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2a8fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a8f3 expref: 20 pid: 5835 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.755298:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638511.755318:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c45500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+20:3293:x1875523183632384:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638511.755324:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788638511.755341:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788638511.755347:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dfe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3291:x1875523183632512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788638511.755354:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638511.755357:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a8ec lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a8e5 expref: 19 pid: 5835 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.755366:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a8ec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a8e5 expref: 19 pid: 5835 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638511.755375:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638511.755398:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dfe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3291:x1875523183632512:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638511.755404:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788638511.755458:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183632512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788638511.755490:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183632384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788638511.755497:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183632256:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788638511.759283:0:11687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2a908 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a901 expref: 18 pid: 5835 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638511.759310:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11687:1875523183631616:0@lo:104: 00010000:00010000:1.0:1788638511.759327:0:11687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2a8fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a8f3 expref: 17 pid: 5835 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638511.759337:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11687:1875523183631744:0@lo:104: 00010000:00010000:1.0:1788638511.759348:0:11687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7380031c00/0xa0b1f1e3b4b2a8ec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2a8e5 expref: 16 pid: 5835 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638511.759357:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11687:1875523183631872:0@lo:104: 00000100:00100000:1.0:1788638511.759369:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11687:1875523183632000:192.168.203.34@tcp:104: 00000100:00100000:2.0:1788638511.768015:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638511.768072:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174159872 00000100:00100000:0.0:1788638511.768082:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174159872 00000100:00100000:2.0:1788638511.768113:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00010000:00010000:0.0:1788638511.768122:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a8de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d9e expref: 13 pid: 5837 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638511.768162:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174160000 00000100:00100000:0.0:1788638511.768166:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174160000 00000100:00100000:2.0:1788638511.768178:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 33 00010000:00010000:0.0:1788638511.768182:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c73bc01d000/0xa0b1f1e3b4b2a8d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d97 expref: 14 pid: 5835 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638511.768195:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b465b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55273f9a-386c-4321-9748-c194b047efe8+14:2364:x1875523174159872:12345-192.168.203.34@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788638511.768201:0:5829:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1788638511.768212:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1788638511.768213:0:5829:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1788638511.768226:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a8de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d9e expref: 14 pid: 5837 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638511.768240:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a8de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d9e expref: 14 pid: 5837 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638511.768258:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7399aa7400/0xa0b1f1e3b4b2a8de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d9e expref: 14 pid: 5837 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638511.768272:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638511.768333:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b465b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55273f9a-386c-4321-9748-c194b047efe8+13:2364:x1875523174159872:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 144us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638511.768342:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 33 00000100:00100000:2.0:1788638511.768363:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 34 00000100:00100000:2.0:1788638511.768370:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b465bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55273f9a-386c-4321-9748-c194b047efe8+12:2364:x1875523174160000:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638511.768379:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638511.768384:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c73bc01d000/0xa0b1f1e3b4b2a8d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d97 expref: 12 pid: 5835 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638511.768393:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c73bc01d000/0xa0b1f1e3b4b2a8d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d97 expref: 12 pid: 5835 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638511.768406:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa3c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638511.768431:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa3c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638511.768444:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa3c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638511.768450:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa3c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638511.768456:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa3c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638511.768461:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa3c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638511.768466:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309c00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638511.768470:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa3c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638511.768477:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa3c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638511.768485:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa3c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638511.768494:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638511.768528:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b465bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55273f9a-386c-4321-9748-c194b047efe8+12:2364:x1875523174160000:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 158us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638511.768534:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 34 00010000:00010000:1.0:1788638511.769188:0:11687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73bc01d000/0xa0b1f1e3b4b2a8d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d97 expref: 11 pid: 5835 timeout: 374 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638511.769204:0:11687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11687:1875523183632128:192.168.203.34@tcp:104: 00010000:00010000:1.0:1788638511.769244:0:11687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa3c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638511.769254:0:11687:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa3c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638511.769260:0:11687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa3c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638511.769266:0:11687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa3c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638512.032887:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638512.352856:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b465b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183632640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788638512.352926:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638512.353368:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183632640 00000100:00100000:2.0:1788638512.353388:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183632640 00000100:00080000:1.0:1788638512.353496:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788638512.354490:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788638512.354507:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183632640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788638512.354554:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788638512.354633:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183632640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (1706us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638512.354641:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788638512.354730:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b465b800 x1875523183632640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638528 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638512.354753:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b465b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183632640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788638512.392290:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638512.392331:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638512.392602:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638512.392640:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638512.392672:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174160384 00000100:00100000:2.0:1788638512.392683:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174160384 00000100:00100000:2.0:1788638512.392747:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 62 00000100:00100000:1.0:1788638512.392819:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174160128 00000100:00100000:1.0:1788638512.392824:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174160128 00000100:00100000:1.0:1788638512.392856:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 253 00000100:00100000:1.0:1788638512.392863:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+11:2365:x1875523174160128:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638512.392932:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386791850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+11:2365:x1875523174160128:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 69us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638512.392940:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 253 00000100:00080000:1.0:1788638512.393087:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788638512.393462:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2365:x1875523174160384:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638512.393504:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4658a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2365:x1875523174160384:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 748us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638512.393513:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 62 00000100:00100000:0.0:1788638512.402016:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174160256 00000100:00100000:0.0:1788638512.402030:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174160256 00000100:00100000:0.0:1788638512.402109:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174160512 00000100:00100000:0.0:1788638512.402112:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174160512 00000100:00100000:0.0:1788638512.402147:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 110 00000100:00100000:0.0:1788638512.402157:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b465aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2365:x1875523174160256:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638512.402237:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b465aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2365:x1875523174160256:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 81us (9955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638512.402259:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 110 00000100:00100000:0.0:1788638512.402276:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 111 00000100:00100000:0.0:1788638512.402282:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b465b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2365:x1875523174160512:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638512.402305:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b465b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2365:x1875523174160512:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 24us (9974us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638512.402311:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 111 00000100:00080000:1.0:1788638512.404254:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788638513.056029:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788638513.119891:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788638513.119899:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c73b4c0d800 from 7 10000000:01000000:1.0:1788638513.119904:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788638513.119951:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385308400/0xa0b1f1e3b4b2aa43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638513.119964:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7385308400/0xa0b1f1e3b4b2aa43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638513.119994:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7385308400/0xa0b1f1e3b4b2aa43 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638513.120018:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183632768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788638513.120086:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638513.120161:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387cf1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788638513.120286:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183632768 00000100:00100000:2.0:1788638513.120294:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183632768 00000100:00100000:2.0:1788638513.120345:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1788638513.120363:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:5840:x1875523183632768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788638513.120376:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638513.120390:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7399aa6800/0xa0b1f1e3b4b2aa4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2aa43 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638513.120421:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7399aa6800/0xa0b1f1e3b4b2aa4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2aa43 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638513.120440:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7399aa6800/0xa0b1f1e3b4b2aa4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2aa43 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638513.120450:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6800, rc 0) 00000100:00100000:2.0:1788638513.120494:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386791450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183632768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638513.120501:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788638513.120720:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183632768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788638513.120736:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7385308400/0xa0b1f1e3b4b2aa43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2aa4a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638513.120746:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7385308400/0xa0b1f1e3b4b2aa43 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2aa4a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638513.120837:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bbb78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183632896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788638513.120866:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638513.120898:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c35840 going to sleep for 11 seconds 00000100:00100000:0.0:1788638513.120958:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183632896 00000100:00100000:0.0:1788638513.120963:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183632896 00000100:00100000:0.0:1788638513.120998:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788638513.121006:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7386793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183632896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638513.121259:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7386793450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183632896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 254us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638513.121267:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788638513.121567:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bbb78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183632896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788638513.121610:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bbb78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183633024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788638513.121647:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638513.121660:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c35840 going to sleep for 11 seconds 00000100:00100000:1.0:1788638513.122064:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183633024 00000100:00100000:1.0:1788638513.122070:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183633024 00000100:00100000:1.0:1788638513.122108:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788638513.122115:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183633024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788638513.122273:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183633024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638513.122281:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788638513.122960:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bbb78a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183633024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788638513.123887:0:11701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bbb78a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:11701:1875523183633152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788638513.123937:0:11701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638513.123972:0:11701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c353c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638513.124023:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183633152 00000100:00100000:1.0:1788638513.124029:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183633152 00000100:00100000:1.0:1788638513.124064:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788638513.124072:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:11701:x1875523183633152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788638513.124314:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:11701:x1875523183633152:12345-0@lo:502:llog_process_th.0 Request processed in 241us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638513.124321:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788638513.124505:0:11701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bbb78a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:11701:1875523183633152:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788638513.124535:0:11701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788638513.124550:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638513.124553:0:11701:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788638513.124560:0:11701:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c73b4c0d800 00000020:00000080:3.0:1788638513.124563:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788638513.124632:0:11701:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bbb78a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:11701:1875523183633280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788638513.124665:0:11701:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638513.124687:0:11701:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c353c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638513.124740:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183633280 00000100:00100000:1.0:1788638513.124744:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183633280 00000100:00100000:1.0:1788638513.124773:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788638513.124780:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:11701:x1875523183633280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788638513.124913:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:11701:x1875523183633280:12345-0@lo:502:llog_process_th.0 Request processed in 133us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638513.124925:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788638513.126279:0:11701:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bbb78a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:11701:1875523183633280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788638513.126312:0:11701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638513.126318:0:11701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638513.126327:0:11701:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788638513.126332:0:11701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788638513.126621:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788638513.126640:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788638513.126652:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385308400/0xa0b1f1e3b4b2aa43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2aa4a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638513.126663:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7385308400/0xa0b1f1e3b4b2aa43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2aa4a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638513.126672:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788638513.126675:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c73bce5d800 from 7 10000000:01000000:1.0:1788638513.126678:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788638513.126707:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385308200/0xa0b1f1e3b4b2aa51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638513.126716:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7385308200/0xa0b1f1e3b4b2aa51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638513.126726:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7385308200/0xa0b1f1e3b4b2aa51 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638513.126745:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183633408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788638513.126829:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638513.126858:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387cf1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788638513.127191:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183633408 00000100:00100000:0.0:1788638513.127198:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183633408 00000100:00100000:0.0:1788638513.127247:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788638513.127255:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:5840:x1875523183633408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788638513.127267:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638513.127279:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73bc01d600/0xa0b1f1e3b4b2aa58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2aa51 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638513.127303:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73bc01d600/0xa0b1f1e3b4b2aa58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2aa51 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638513.127314:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73bc01d600/0xa0b1f1e3b4b2aa58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2aa51 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638513.127331:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01d600, rc 0) 00000100:00100000:0.0:1788638513.127385:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183633408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638513.127392:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788638513.127428:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183633408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788638513.127441:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7385308200/0xa0b1f1e3b4b2aa51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2aa58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638513.127451:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7385308200/0xa0b1f1e3b4b2aa51 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2aa58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638513.127501:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183633536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638513.127538:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638513.127553:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32000 going to sleep for 11 seconds 00000100:00100000:0.0:1788638513.127564:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183633536 00000100:00100000:0.0:1788638513.127567:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183633536 00000100:00100000:0.0:1788638513.127584:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788638513.127590:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183633536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638513.127894:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183633536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 303us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638513.127901:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788638513.127930:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183633536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638513.127964:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183633664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788638513.128000:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638513.128020:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32000 going to sleep for 11 seconds 00000100:00100000:0.0:1788638513.128032:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183633664 00000100:00100000:0.0:1788638513.128036:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183633664 00000100:00100000:0.0:1788638513.128053:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788638513.128060:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183633664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788638513.128195:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183633664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 135us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638513.128202:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788638513.128236:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183633664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788638513.128384:0:11702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:11702:1875523183633792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638513.128420:0:11702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638513.128439:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183633792 00000100:00100000:0.0:1788638513.128443:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183633792 00000100:00100000:0.0:1788638513.128459:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788638513.128463:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:11702:x1875523183633792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638513.128587:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:11702:x1875523183633792:12345-0@lo:502:llog_process_th.0 Request processed in 122us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638513.128593:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788638513.128618:0:11702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638513.128629:0:11702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:11702:1875523183633792:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788638513.128648:0:11702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788638513.128656:0:11702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638513.128658:0:11702:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788638513.128665:0:11702:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c73bce5d800 00000020:00000080:0.0:1788638513.128667:0:11702:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788638513.128724:0:11702:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:11702:1875523183633920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638513.128759:0:11702:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638513.128776:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183633920 00000100:00100000:0.0:1788638513.128799:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183633920 00000100:00100000:0.0:1788638513.128816:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788638513.128821:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:11702:x1875523183633920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638513.128917:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:11702:x1875523183633920:12345-0@lo:502:llog_process_th.0 Request processed in 95us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638513.128924:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788638513.128951:0:11702:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638513.128963:0:11702:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:11702:1875523183633920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788638513.128981:0:11702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638513.128985:0:11702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638513.128987:0:11702:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788638513.128990:0:11702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788638513.129032:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788638513.129050:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788638513.129058:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385308200/0xa0b1f1e3b4b2aa51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2aa58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638513.129067:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7385308200/0xa0b1f1e3b4b2aa51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2aa58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638513.129077:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788638513.129080:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c7387a11800 from 7 10000000:01000000:0.0:1788638513.129082:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788638513.129102:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2aa5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638513.129110:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2aa5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638513.129126:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2aa5f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638513.129139:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183634048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788638513.129165:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638513.129179:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638513.129190:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183634048 00000100:00100000:0.0:1788638513.129193:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183634048 00000100:00100000:0.0:1788638513.129211:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788638513.129217:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:5840:x1875523183634048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788638513.129224:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638513.129235:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73bc01d400/0xa0b1f1e3b4b2aa66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2aa5f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638513.129252:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73bc01d400/0xa0b1f1e3b4b2aa66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2aa5f expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638513.129261:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73bc01d400/0xa0b1f1e3b4b2aa66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2aa5f expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638513.129268:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01d400, rc 0) 00000100:00100000:0.0:1788638513.129293:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:5840:x1875523183634048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638513.129299:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788638513.129325:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183634048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788638513.129335:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2aa5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2aa66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638513.129351:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2aa5f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2aa66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638513.129388:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183634176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638513.129412:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638513.129424:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638513.129435:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183634176 00000100:00100000:0.0:1788638513.129508:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183634176 00000100:00100000:0.0:1788638513.129523:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788638513.129540:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:5840:x1875523183634176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638513.129699:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:5840:x1875523183634176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638513.129706:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788638513.129732:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183634176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638513.129756:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183634304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788638513.129807:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638513.129820:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638513.129831:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183634304 00000100:00100000:0.0:1788638513.129834:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183634304 00000100:00100000:0.0:1788638513.129850:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788638513.129855:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:5840:x1875523183634304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788638513.129950:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:5840:x1875523183634304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 94us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638513.129957:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788638513.129993:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:5840:1875523183634304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788638513.134269:0:11703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:11703:1875523183634432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638513.134346:0:11703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638513.134652:0:11703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c326c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638513.136187:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183634432 00000100:00100000:1.0:1788638513.136198:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183634432 00000100:00100000:1.0:1788638513.136292:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788638513.136302:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:11703:x1875523183634432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788638513.140500:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:11703:x1875523183634432:12345-0@lo:502:llog_process_th.0 Request processed in 4190us (6144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638513.140746:0:11703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:11703:1875523183634432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788638513.141037:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000020:01000000:0.0:1788638513.141647:0:11703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788638513.141658:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638513.141660:0:11703:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788638513.141778:0:11703:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c7387a11800 00000020:00000080:0.0:1788638513.141871:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788638513.142043:0:11703:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:11703:1875523183634560:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638513.142178:0:11703:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638513.142213:0:11703:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c326c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638513.144205:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183634560 00000100:00100000:3.0:1788638513.144216:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183634560 00000100:00100000:3.0:1788638513.144266:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1788638513.144276:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:11703:x1875523183634560:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788638513.144557:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:11703:x1875523183634560:12345-0@lo:502:llog_process_th.0 Request processed in 282us (2379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638513.144565:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788638513.144865:0:11703:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:11703:1875523183634560:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788638513.144904:0:11703:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788638513.144912:0:11703:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788638513.144914:0:11703:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788638513.144919:0:11703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788638513.147220:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788638513.147251:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788638513.147262:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2aa5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2aa66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638513.147275:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2aa5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2aa66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788638513.159248:0:11706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788638513.731265:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638513.731356:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174160640 00000100:00100000:0.0:1788638513.731366:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174160640 00000100:00100000:0.0:1788638513.731423:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 269 00000100:00100000:0.0:1788638513.731433:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+11:5608:x1875523174160640:12345-192.168.203.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788638513.731449:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638513.731469:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73bc01de00/0xa0b1f1e3b4b2aa6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434deb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638513.731507:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73bc01de00/0xa0b1f1e3b4b2aa6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434deb expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638513.731543:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73bc01de00/0xa0b1f1e3b4b2aa6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434deb expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638513.731553:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01de00, rc 0) 00000100:00100000:0.0:1788638513.731659:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+12:5608:x1875523174160640:12345-192.168.203.34@tcp:101:ll_cfg_requeue.0 Request processed in 227us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638513.731666:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 269 00000100:00100000:2.0:1788638513.738184:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638513.738298:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174160768 00000100:00100000:3.0:1788638513.738308:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174160768 00000100:00100000:3.0:1788638513.738361:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 270 00000100:00100000:3.0:1788638513.738372:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+12:5608:x1875523174160768:12345-192.168.203.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788638513.738917:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+12:5608:x1875523174160768:12345-192.168.203.34@tcp:501:ll_cfg_requeue.0 Request processed in 545us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638513.738926:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 270 00000100:00100000:1.0:1788638513.741401:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638513.741823:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174160896 00000100:00100000:3.0:1788638513.741834:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174160896 00000100:00100000:3.0:1788638513.741892:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 271 00000100:00100000:3.0:1788638513.741916:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+12:5608:x1875523174160896:12345-192.168.203.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788638513.742136:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+12:5608:x1875523174160896:12345-192.168.203.34@tcp:503:ll_cfg_requeue.0 Request processed in 222us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638513.742145:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 271 00000100:00100000:1.0:1788638513.745978:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638513.746075:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174161024 00000100:00100000:0.0:1788638513.746086:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174161024 00000100:00100000:0.0:1788638513.746142:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 272 00000100:00100000:0.0:1788638513.746152:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+12:9977:x1875523174161024:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788638513.746416:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+12:9977:x1875523174161024:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 263us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638513.746425:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 272 00000100:00100000:2.0:1788638513.751941:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638513.752065:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174161152 00000100:00100000:0.0:1788638513.752075:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174161152 00000100:00100000:0.0:1788638513.752496:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 273 00000100:00100000:0.0:1788638513.752510:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+12:9977:x1875523174161152:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788638513.753478:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+12:9977:x1875523174161152:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 814us (1399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638513.753498:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 273 00000100:00100000:1.0:1788638513.766013:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638513.766111:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174161280 00000100:00100000:3.0:1788638513.766122:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174161280 00000100:00100000:3.0:1788638513.766179:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 274 00000100:00100000:3.0:1788638513.766191:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+12:5608:x1875523174161280:12345-192.168.203.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788638513.766207:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638513.766225:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7380031200/0xa0b1f1e3b4b2aa74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434df2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638513.766252:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7380031200/0xa0b1f1e3b4b2aa74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434df2 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638513.766265:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7380031200/0xa0b1f1e3b4b2aa74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434df2 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638513.766275:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031200, rc 0) 00000100:00100000:3.0:1788638513.766540:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+13:5608:x1875523174161280:12345-192.168.203.34@tcp:101:ll_cfg_requeue.0 Request processed in 350us (535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638513.766547:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 274 00000100:00100000:3.0:1788638513.775179:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638513.775309:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174161408 00000100:00100000:0.0:1788638513.775318:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174161408 00000100:00100000:2.0:1788638513.778063:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 275 00000100:00100000:2.0:1788638513.778089:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73836d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+13:5608:x1875523174161408:12345-192.168.203.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788638513.778403:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73836d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+13:5608:x1875523174161408:12345-192.168.203.34@tcp:501:ll_cfg_requeue.0 Request processed in 326us (3232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638513.778413:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 275 00000100:00100000:0.0:1788638513.785952:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638513.786241:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174161536 00000100:00100000:3.0:1788638513.786251:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174161536 00000100:00100000:3.0:1788638513.786311:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 276 00000100:00100000:3.0:1788638513.786329:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+13:5608:x1875523174161536:12345-192.168.203.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788638513.786570:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383686450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+13:5608:x1875523174161536:12345-192.168.203.34@tcp:503:ll_cfg_requeue.0 Request processed in 249us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638513.786579:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 276 00000100:00100000:0.0:1788638513.797575:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638513.797829:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174161664 00000100:00100000:3.0:1788638513.797841:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174161664 00000100:00100000:3.0:1788638513.797901:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 277 00000100:00100000:3.0:1788638513.797911:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+13:9980:x1875523174161664:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788638513.798155:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383684c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+13:9980:x1875523174161664:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 245us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638513.798164:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 277 00000100:00100000:0.0:1788638513.808132:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638513.808631:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174161792 00000100:00100000:1.0:1788638513.808641:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174161792 00000100:00100000:1.0:1788638513.808701:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 278 00000100:00100000:1.0:1788638513.808712:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:9980:x1875523174161792:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788638513.809012:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383687850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:9980:x1875523174161792:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 301us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638513.809021:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 278 00010000:00010000:0.0:1788638514.080020:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788638514.208466:0:11706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788638514.400275:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183634816:0@lo:400:kworker.0 00000100:00100000:2.0:1788638514.400357:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638514.400438:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183635328:0@lo:400:kworker.0 00000100:00100000:1.0:1788638514.400451:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183634816 00000100:00100000:1.0:1788638514.400460:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183634816 00000100:00100000:0.0:1788638514.400472:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183634688:0@lo:400:kworker.0 00000100:00100000:2.0:1788638514.400481:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638514.400534:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638514.400539:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788638514.400550:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183634816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638514.400575:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183635328 00000100:00100000:0.0:1788638514.400579:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183635200:0@lo:400:kworker.0 00000100:00100000:2.0:1788638514.400581:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183635328 00000100:00100000:1.0:1788638514.400612:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183634816:12345-0@lo:400:kworker.0 Request processed in 63us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638514.400619:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638514.400626:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788638514.400634:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788638514.400643:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3294:x1875523183635328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638514.400683:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3294:x1875523183635328:12345-0@lo:400:kworker.0 Request processed in 42us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638514.400706:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183635200 00000100:00100000:2.0:1788638514.400709:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788638514.400711:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183635200 00000100:00100000:3.0:1788638514.400722:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183634944:0@lo:400:kworker.0 00000100:00100000:2.0:1788638514.400739:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183635072:0@lo:400:kworker.0 00000100:00100000:1.0:1788638514.400743:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788638514.400752:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183635200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638514.400762:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638514.400818:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638514.400819:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183635200:12345-0@lo:400:kworker.0 Request processed in 67us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638514.400827:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788638514.400851:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183634944 00000100:00100000:1.0:1788638514.400854:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183634944 00000100:00080000:2.0:1788638514.400860:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638514.400867:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183634816:0@lo:400:kworker.0 00000100:00080000:2.0:1788638514.400868:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788638514.400877:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788638514.400885:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183635072 00000100:00100000:1.0:1788638514.400886:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183634944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638514.400888:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183635328:0@lo:400:kworker.0 00000100:00100000:2.0:1788638514.400891:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183635072 00000100:00100000:3.0:1788638514.400928:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183634688 00000100:00100000:1.0:1788638514.400931:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183634944:12345-0@lo:400:kworker.0 Request processed in 46us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638514.400934:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183634688 00000100:00100000:2.0:1788638514.400936:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788638514.400945:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788638514.400950:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183635072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638514.400979:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788638514.400990:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183634688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638514.400993:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183634944:0@lo:400:kworker.0 00000100:00100000:2.0:1788638514.401001:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183635072:12345-0@lo:400:kworker.0 Request processed in 53us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638514.401009:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788638514.401035:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383684450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183634688:12345-0@lo:400:kworker.0 Request processed in 47us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638514.401043:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1788638514.401051:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183634688:0@lo:400:kworker.0 00000100:00100000:1.0:1788638514.401064:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183635200:0@lo:400:kworker.0 00010000:00080000:3.0:1788638514.401107:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73ad30d180 x1875523183635072/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638514.401130:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183635072:0@lo:400:kworker.0 00000100:00080000:2.0:1788638514.401591:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788638514.912878:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788638514.912900:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183635456:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788638514.912960:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638514.913026:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183635456 00000100:00100000:0.0:1788638514.913034:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183635456 00000100:00100000:0.0:1788638514.913075:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788638514.913084:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1875523183635456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788638514.913118:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638514.913161:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3292:x1875523183635456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638514.913168:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788638514.913222:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183635456:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788638515.104007:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788638516.011018:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:0.0:1788638516.128014:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638517.152371:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638517.472571:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7282ffca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183635584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788638517.472646:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638517.472802:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183635584 00000100:00100000:3.0:1788638517.472811:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183635584 00000100:00100000:3.0:1788638517.472881:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788638517.472891:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183635584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788638517.472927:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788638517.472982:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183635584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638517.472989:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1788638517.473076:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7282ffca80 x1875523183635584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638533 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638517.473096:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7282ffca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183635584:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788638517.473182:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788638517.523861:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638517.523904:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638517.523939:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638517.524022:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174162048 00000100:00100000:2.0:1788638517.524032:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174162048 00000100:00100000:2.0:1788638517.524106:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 115 00000100:00100000:2.0:1788638517.524133:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2364:x1875523174162048:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638517.524205:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2364:x1875523174162048:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 90us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638517.524212:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 115 00000100:00100000:1.0:1788638517.524641:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174162176 00000100:00100000:1.0:1788638517.524647:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174162176 00000100:00100000:1.0:1788638517.524692:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 65 00000100:00100000:1.0:1788638517.524700:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2364:x1875523174162176:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638517.524738:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2364:x1875523174162176:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 39us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638517.524744:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 65 00000100:00100000:3.0:1788638517.524865:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174161920 00000100:00100000:3.0:1788638517.524870:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174161920 00000100:00100000:3.0:1788638517.524909:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 280 00000100:00100000:3.0:1788638517.524917:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+13:2364:x1875523174161920:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638517.524948:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383687c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+13:2364:x1875523174161920:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 31us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638517.524955:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 280 00000100:00080000:0.0:1788638517.525188:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788638517.525193:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638517.535938:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638517.536071:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174162304 00000100:00100000:1.0:1788638517.536081:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174162304 00000100:00100000:1.0:1788638517.536208:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 116 00000100:00100000:1.0:1788638517.536220:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2364:x1875523174162304:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638517.536300:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2364:x1875523174162304:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 82us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638517.536308:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 116 00000100:00080000:0.0:1788638517.537119:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788638518.175923:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638519.199942:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638519.520236:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183635712:0@lo:400:kworker.0 00000100:00100000:1.0:1788638519.520318:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638519.520381:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183636224:0@lo:400:kworker.0 00000100:00100000:2.0:1788638519.520391:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7398bf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183635968:0@lo:400:kworker.0 00000100:00100000:3.0:1788638519.520409:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183635840:0@lo:400:kworker.0 00000100:00100000:1.0:1788638519.520417:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638519.520440:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638519.520468:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638519.520471:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183635712 00000100:00100000:1.0:1788638519.520479:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183635712 00000100:00100000:2.0:1788638519.520499:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183636224 00000100:00100000:0.0:1788638519.520504:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183636096:0@lo:400:kworker.0 00000100:00100000:2.0:1788638519.520506:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183636224 00000100:00100000:3.0:1788638519.520510:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183636352:0@lo:400:kworker.0 00000100:00100000:0.0:1788638519.520555:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638519.520566:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183635968 00000100:00100000:2.0:1788638519.520578:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183635968 00000100:00100000:3.0:1788638519.520600:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183635840 00000100:00100000:0.0:1788638519.520605:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183636096 00000100:00100000:3.0:1788638519.520606:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183635840 00000100:00100000:0.0:1788638519.520611:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183636096 00000100:00100000:2.0:1788638519.520612:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788638519.520627:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183636224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638519.520639:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788638519.520649:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183635968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638519.520654:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788638519.520665:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183636096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638519.520693:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183636224:12345-0@lo:400:kworker.0 Request processed in 70us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638519.520701:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788638519.520718:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183636096:12345-0@lo:400:kworker.0 Request processed in 54us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638519.520727:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788638519.520728:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788638519.520730:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282fff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183635968:12345-0@lo:400:kworker.0 Request processed in 82us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638519.520741:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788638519.520745:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183635840:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788638519.520752:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788638519.520758:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638519.520771:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638519.520874:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1788638519.520880:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183635712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638519.522433:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183635840:12345-0@lo:400:kworker.0 Request processed in 1687us (1960us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638519.522447:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788638519.522512:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383687050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183635712:12345-0@lo:400:kworker.0 Request processed in 1630us (2192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638519.522522:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788638519.522528:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183636352 00000100:00100000:2.0:1788638519.522535:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183636352 00000100:00100000:1.0:1788638519.522590:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183635712:0@lo:400:kworker.0 00000100:00100000:2.0:1788638519.522603:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788638519.522612:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c28e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183636224:0@lo:400:kworker.0 00000100:00100000:3.0:1788638519.522613:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183635840:0@lo:400:kworker.0 00000100:00100000:2.0:1788638519.522613:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183636352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638519.522724:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7398bf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183635968:0@lo:400:kworker.0 00000100:00100000:2.0:1788638519.522740:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183636352:12345-0@lo:400:kworker.0 Request processed in 128us (1968us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638519.522748:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:3.0:1788638519.522755:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788638519.522766:0:3294:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00010000:00080000:0.0:1788638519.522864:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7384c29f80 x1875523183636096/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638519.522876:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183636096:0@lo:400:kworker.0 00000004:00080000:1.0:1788638519.522932:0:3294:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c73b7c44700, transno 4294967300 00000100:00100000:1.0:1788638519.522946:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183636352:0@lo:400:kworker.0 00000100:00100000:1.0:1788638520.032060:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183636480:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788638520.032134:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638520.032400:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183636480 00000100:00100000:3.0:1788638520.032409:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183636480 00000100:00100000:3.0:1788638520.032470:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788638520.032479:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183636480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788638520.032531:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788638520.032579:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183636480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (444us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638520.032586:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788638520.032701:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183636480:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788638520.224086:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638521.247933:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638522.274890:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638522.592146:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7282ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183636608:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788638522.592226:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638522.592286:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183636608 00000100:00100000:0.0:1788638522.592622:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183636608 00000100:00100000:0.0:1788638522.592686:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788638522.592694:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183636608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788638522.592769:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788638522.592854:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788638522.595922:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183636608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3220us (3688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638522.595937:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1788638522.597411:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7282ffd880 x1875523183636608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638538 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638522.597457:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7282ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183636608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788638522.626665:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638522.627140:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174162432 00000100:00100000:1.0:1788638522.627150:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174162432 00000100:00100000:1.0:1788638522.627214:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 282 00000100:00100000:1.0:1788638522.627234:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:2364:x1875523174162432:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638522.627317:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383684850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:2364:x1875523174162432:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 86us (661us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638522.627499:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 282 00000100:00100000:2.0:1788638522.635831:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638522.635870:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638522.635903:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638522.635981:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174162688 00000100:00100000:1.0:1788638522.635991:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174162688 00000100:00100000:1.0:1788638522.636059:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 68 00000100:00100000:1.0:1788638522.636069:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2364:x1875523174162688:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638522.636138:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2364:x1875523174162688:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 71us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638522.636146:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 68 00000100:00100000:0.0:1788638522.636530:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174162560 00000100:00100000:0.0:1788638522.636536:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174162560 00000100:00100000:0.0:1788638522.636583:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174162816 00000100:00100000:0.0:1788638522.636586:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174162816 00000100:00100000:0.0:1788638522.636623:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 120 00000100:00100000:0.0:1788638522.636632:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2364:x1875523174162560:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638522.636674:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2364:x1875523174162560:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 43us (851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638522.636682:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 120 00000100:00100000:0.0:1788638522.636695:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 121 00000100:00100000:0.0:1788638522.636702:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2364:x1875523174162816:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638522.636726:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2364:x1875523174162816:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 24us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638522.636732:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 121 00000100:00080000:2.0:1788638522.637647:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788638522.637656:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788638523.295933:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638524.320036:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788638524.448607:0:11706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788638524.640537:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183636864:0@lo:400:kworker.0 00000100:00100000:3.0:1788638524.640607:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638524.640671:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183637376:0@lo:400:kworker.0 00000100:00100000:3.0:1788638524.640697:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638524.640725:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788638524.640731:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183636736:0@lo:400:kworker.0 00000100:00100000:3.0:1788638524.640760:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638524.640778:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183637248:0@lo:400:kworker.0 00000100:00100000:3.0:1788638524.640822:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638524.640866:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183636864 00000100:00100000:3.0:1788638524.640873:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183636864 00000100:00100000:3.0:1788638524.640912:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183637248 00000100:00100000:3.0:1788638524.640915:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183637248 00000100:00100000:3.0:1788638524.640944:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788638524.640953:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183636864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638524.641001:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183636864:12345-0@lo:400:kworker.0 Request processed in 49us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638524.641008:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1788638524.641021:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788638524.641026:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183637248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638524.641049:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183637248:12345-0@lo:400:kworker.0 Request processed in 23us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638524.641054:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788638524.641087:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183637248:0@lo:400:kworker.0 00000100:00100000:3.0:1788638524.641098:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183636864:0@lo:400:kworker.0 00000100:00100000:0.0:1788638524.641199:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183636992:0@lo:400:kworker.0 00000100:00100000:0.0:1788638524.641230:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638524.641262:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638524.641268:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183637120:0@lo:400:kworker.0 00000100:00100000:0.0:1788638524.641291:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638524.641421:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183636736 00000100:00100000:1.0:1788638524.641426:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183636736 00000100:00100000:1.0:1788638524.641471:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788638524.641479:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183636736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638524.641518:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383686850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183636736:12345-0@lo:400:kworker.0 Request processed in 41us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638524.641524:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788638524.641552:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183636992 00000100:00100000:1.0:1788638524.641555:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183636992 00000100:00100000:1.0:1788638524.641589:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788638524.641595:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183636992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638524.641629:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183636992:12345-0@lo:400:kworker.0 Request processed in 34us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638524.641635:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788638524.641661:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183636992:0@lo:400:kworker.0 00000100:00100000:1.0:1788638524.641682:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183637376 00000100:00100000:1.0:1788638524.641686:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183637376 00000100:00100000:1.0:1788638524.641710:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183637120 00000100:00100000:1.0:1788638524.641713:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183637120 00000100:00100000:1.0:1788638524.641728:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788638524.641734:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183637376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638524.641766:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb7aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183637376:12345-0@lo:400:kworker.0 Request processed in 32us (1068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638524.641772:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788638524.641810:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788638524.641817:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183637120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638524.641847:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183637120:12345-0@lo:400:kworker.0 Request processed in 31us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638524.641854:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:1.0:1788638524.641881:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73bf61c000 x1875523183637120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638540 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638524.641892:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183637120:0@lo:400:kworker.0 00000100:00100000:1.0:1788638524.641915:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183636736:0@lo:400:kworker.0 00000100:00100000:1.0:1788638524.641925:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183637376:0@lo:400:kworker.0 00000100:00080000:2.0:1788638524.642043:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788638524.642048:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788638524.642050:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788638525.155713:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738723f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183637504:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788638525.155807:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638525.156120:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183637504 00000100:00100000:3.0:1788638525.156138:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183637504 00000100:00100000:3.0:1788638525.156192:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788638525.156201:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183637504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788638525.156236:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788638525.156292:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183637504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638525.156299:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788638525.156593:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738723f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183637504:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788638525.343952:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638526.368188:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638527.392055:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638527.713910:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788638527.713941:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183637632:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788638527.714029:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638527.714142:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183637632 00000100:00100000:2.0:1788638527.714151:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183637632 00000100:00100000:2.0:1788638527.714223:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788638527.714233:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183637632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788638527.714267:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788638527.714315:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183637632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638527.714322:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1788638527.714363:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73bf61f480 x1875523183637632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638543 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638527.714381:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183637632:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788638527.714731:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788638527.747839:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638527.747886:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638527.748106:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174163072 00000100:00100000:3.0:1788638527.748115:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174163072 00000100:00100000:3.0:1788638527.748188:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 125 00000100:00100000:3.0:1788638527.748198:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2367:x1875523174163072:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638527.748280:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2367:x1875523174163072:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 84us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638527.748288:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 125 00000100:00100000:1.0:1788638527.748310:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174162944 00000100:00100000:1.0:1788638527.748314:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174162944 00000100:00100000:1.0:1788638527.748351:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 284 00000100:00100000:1.0:1788638527.748359:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:2367:x1875523174162944:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638527.748385:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383685c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:2367:x1875523174162944:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 28us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638527.748392:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 284 00000100:00080000:2.0:1788638527.748477:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638527.761890:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638527.762005:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638527.762076:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174163328 00000100:00100000:3.0:1788638527.762085:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174163328 00000100:00100000:3.0:1788638527.762152:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 126 00000100:00100000:3.0:1788638527.762162:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2366:x1875523174163328:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638527.762231:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2366:x1875523174163328:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 71us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638527.762238:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 126 00000100:00080000:0.0:1788638527.762872:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638527.763092:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174163200 00000100:00100000:2.0:1788638527.763099:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174163200 00000100:00100000:2.0:1788638527.763188:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 19 00000100:00100000:2.0:1788638527.763197:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2363:x1875523174163200:12345-192.168.203.34@tcp:9:kworker.0 00000020:00000080:2.0:1788638527.763216:0:6686:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a9b0 00000100:00080000:2.0:1788638527.763224:0:6686:0:(import.c:65:import_set_state_nolock()) ffff9c73ad6eb800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788638527.763267:0:6686:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1788638527.763633:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+2:2363:x1875523174163200:12345-192.168.203.34@tcp:9:kworker.0 Request processed in 436us (1750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638527.763642:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 19 00010000:00010000:3.0:1788638527.764096:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788638527.764188:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788638528.416224:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638529.444315:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638529.760112:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bbb79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183637760:0@lo:400:kworker.0 00000100:00100000:1.0:1788638529.760198:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638529.760467:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183637760 00000100:00100000:0.0:1788638529.760475:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183637760 00000100:00100000:0.0:1788638529.760534:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788638529.760543:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183637760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638529.760780:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bbb78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183637888:0@lo:400:kworker.0 00000100:00100000:2.0:1788638529.760843:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638529.760895:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183637888 00000100:00100000:2.0:1788638529.760910:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183637888 00000100:00100000:2.0:1788638529.760956:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788638529.760963:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183637888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638529.761002:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183637888:12345-0@lo:400:kworker.0 Request processed in 40us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638529.761008:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788638529.761048:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bbb78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183637888:0@lo:400:kworker.0 00000100:00100000:0.0:1788638529.763060:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383686050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183637760:12345-0@lo:400:kworker.0 Request processed in 2511us (2855us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638529.763073:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1788638529.763518:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bbb79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183637760:0@lo:400:kworker.0 00000100:00100000:3.0:1788638529.764057:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bbb7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183638400:0@lo:400:kworker.0 00000100:00100000:3.0:1788638529.764109:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638529.764205:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788638529.764212:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bbb79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183638272:0@lo:400:kworker.0 00000100:00100000:3.0:1788638529.764238:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638529.764270:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183638400 00000100:00100000:1.0:1788638529.764384:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183638272 00000100:00100000:1.0:1788638529.764390:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183638272 00000100:00100000:1.0:1788638529.764455:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788638529.764464:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183638272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638529.764516:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183638272:12345-0@lo:400:kworker.0 Request processed in 53us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638529.764522:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1788638529.764539:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638529.764614:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183638400 00000100:00100000:3.0:1788638529.764652:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788638529.764660:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183638400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638529.764705:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183638400:12345-0@lo:400:kworker.0 Request processed in 47us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638529.764712:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788638529.764742:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bbb79500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183638272:0@lo:400:kworker.0 00000100:00100000:3.0:1788638529.764753:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bbb7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183638400:0@lo:400:kworker.0 00000100:00080000:1.0:1788638529.764821:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788638529.764874:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bbb79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183638016:0@lo:400:kworker.0 00000100:00100000:2.0:1788638529.764972:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638529.765000:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788638529.765006:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bbb7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183638144:0@lo:400:kworker.0 00000100:00100000:2.0:1788638529.765030:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638529.765062:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183638144 00000100:00100000:2.0:1788638529.765066:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183638144 00000100:00100000:2.0:1788638529.765094:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788638529.765101:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183638144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638529.765204:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183638144:12345-0@lo:400:kworker.0 Request processed in 103us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638529.765210:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:2.0:1788638529.765239:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73bbb7ad80 x1875523183638144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638545 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638529.765249:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bbb7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183638144:0@lo:400:kworker.0 00000100:00100000:3.0:1788638529.765429:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183638016 00000100:00100000:3.0:1788638529.765434:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183638016 00000100:00100000:3.0:1788638529.765470:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788638529.765477:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183638016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638529.765520:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183638016:12345-0@lo:400:kworker.0 Request processed in 44us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638529.765526:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1788638529.765638:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788638529.765641:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788638529.765698:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bbb79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183638016:0@lo:400:kworker.0 00000100:00100000:2.0:1788638530.272140:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7398c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183638528:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788638530.272233:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638530.272401:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183638528 00000100:00100000:3.0:1788638530.272409:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183638528 00000100:00100000:3.0:1788638530.272671:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788638530.272682:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183638528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788638530.272719:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788638530.275713:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183638528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3023us (3471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638530.275728:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788638530.275886:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7398c2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183638528:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788638530.466398:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788638531.336182:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 00196f64-ae55-4ffc-b84c-468028ab3a77 00000020:00000080:3.0:1788638531.336192:0:7651:0:(genops.c:885:class_export_put()) final put ffff9c73ad6ee000/00196f64-ae55-4ffc-b84c-468028ab3a77 00000020:00000080:0.0:1788638531.336335:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73ad6ee000/00196f64-ae55-4ffc-b84c-468028ab3a77 for lustre-OST0001 00000020:00000080:0.0:1788638531.336513:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73ad6eb800 for lustre-OST0001 00010000:00010000:0.0:1788638531.488199:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638532.513251:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638532.838511:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183638656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788638532.838611:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638532.838683:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183638656 00000100:00100000:2.0:1788638532.838691:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183638656 00000100:00100000:2.0:1788638532.839131:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788638532.839142:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183638656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788638532.839176:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788638532.839328:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183638656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 188us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638532.839336:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1788638532.839417:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788638532.839450:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73bf61ca80 x1875523183638656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638548 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638532.839468:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183638656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788638532.866509:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638532.866601:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638532.866637:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638532.866666:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174163712 00000100:00100000:0.0:1788638532.866683:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174163712 00000100:00100000:0.0:1788638532.866756:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174163584 00000100:00100000:0.0:1788638532.866759:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174163584 00000100:00100000:0.0:1788638532.866802:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 130 00000100:00100000:0.0:1788638532.866812:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2364:x1875523174163712:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638532.866881:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2364:x1875523174163712:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 69us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638532.866889:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 130 00000100:00100000:0.0:1788638532.866908:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 131 00000100:00100000:0.0:1788638532.866915:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2364:x1875523174163584:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638532.866939:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2364:x1875523174163584:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 25us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638532.866946:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 131 00000100:00100000:2.0:1788638532.868234:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174163456 00000100:00100000:2.0:1788638532.868247:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174163456 00000100:00100000:2.0:1788638532.868300:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 286 00000100:00100000:2.0:1788638532.868309:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+13:2364:x1875523174163456:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638532.868357:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383686c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+13:2364:x1875523174163456:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 50us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638532.868485:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 286 00000100:00080000:2.0:1788638532.868532:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788638533.541879:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638534.559953:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788638534.691395:0:11706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788638534.881172:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7398c2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183639040:0@lo:400:kworker.0 00000100:00100000:3.0:1788638534.881466:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7398c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183638912:0@lo:400:kworker.0 00000100:00100000:3.0:1788638534.881536:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638534.881608:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7398c2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183639424:0@lo:400:kworker.0 00000100:00100000:1.0:1788638534.881966:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7398c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183638784:0@lo:400:kworker.0 00000100:00100000:0.0:1788638534.882182:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638534.882226:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638534.882232:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7398c2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183639168:0@lo:400:kworker.0 00000100:00100000:0.0:1788638534.882255:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638534.882290:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183638912 00000100:00100000:0.0:1788638534.882297:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183638912 00000100:00100000:0.0:1788638534.882390:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183639040 00000100:00100000:0.0:1788638534.882394:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183639040 00000100:00100000:0.0:1788638534.882424:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788638534.882433:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183638912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638534.882489:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183638912:12345-0@lo:400:kworker.0 Request processed in 57us (953us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638534.882502:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788638534.882518:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788638534.882523:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183639040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638534.882567:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183639040:12345-0@lo:400:kworker.0 Request processed in 43us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638534.882573:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788638534.882604:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183639168 00000100:00100000:0.0:1788638534.882608:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183639168 00000100:00100000:0.0:1788638534.882647:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788638534.882654:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183639168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638534.882685:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183639168:12345-0@lo:400:kworker.0 Request processed in 32us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638534.882691:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1788638534.882722:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788638534.882726:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788638534.882755:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7398c2ed80 x1875523183639168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638550 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638534.882769:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7398c2ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183639168:0@lo:400:kworker.0 00000100:00100000:0.0:1788638534.882801:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7398c2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183639040:0@lo:400:kworker.0 00000100:00100000:1.0:1788638534.886529:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638534.886583:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7398c2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183639296:0@lo:400:kworker.0 00000100:00100000:1.0:1788638534.886623:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638534.886682:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183638784 00000100:00100000:1.0:1788638534.886689:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183638784 00000100:00100000:1.0:1788638534.886733:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788638534.886742:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183638784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638534.886808:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383684050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183638784:12345-0@lo:400:kworker.0 Request processed in 68us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638534.886815:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788638534.886844:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183639296 00000100:00100000:1.0:1788638534.886847:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183639296 00000100:00100000:1.0:1788638534.886882:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788638534.886887:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183639296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638534.886918:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183639296:12345-0@lo:400:kworker.0 Request processed in 31us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638534.886924:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:1.0:1788638534.886942:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788638534.886970:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7398c2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183638784:0@lo:400:kworker.0 00000100:00100000:1.0:1788638534.886982:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7398c2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183639296:0@lo:400:kworker.0 00000100:00100000:3.0:1788638534.888728:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638534.888823:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7398c2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183638912:0@lo:400:kworker.0 00000100:00100000:1.0:1788638534.888910:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183639424 00000100:00100000:1.0:1788638534.888916:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183639424 00000100:00100000:1.0:1788638534.888983:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788638534.888991:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183639424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638534.889055:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb79500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183639424:12345-0@lo:400:kworker.0 Request processed in 65us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638534.889072:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788638534.889084:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7398c2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183639424:0@lo:400:kworker.0 00000100:00080000:2.0:1788638534.889134:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788638535.394815:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788638535.394838:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7398c2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183639552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788638535.394910:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638535.395071:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183639552 00000100:00100000:0.0:1788638535.395079:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183639552 00000100:00100000:0.0:1788638535.395134:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788638535.395144:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183639552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788638535.395178:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788638535.395362:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7398c2d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183639552:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788638535.395481:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183639552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 338us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638535.395500:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000001:02000400:3.0:1788638535.538639:0:11871:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 16:02:14 (1788638534) 00010000:00010000:0.0:1788638535.584021:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638536.612150:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638537.367742:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638537.367819:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174163840 00000100:00100000:0.0:1788638537.367829:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174163840 00000100:00100000:0.0:1788638537.367903:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 32 00000100:00100000:0.0:1788638537.367914:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+5:10250:x1875523174163840:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788638537.367934:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638537.367957:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2aa7b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434df9 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.368021:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2aa82 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.368036:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2aa82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.368049:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2aa82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638537.368083:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788638537.368087:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638537.368156:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2aa82 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.368182:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2aa7b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434df9 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.368201:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2aa82 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434df9 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.368229:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:0.0:1788638537.368232:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788638537.368236:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01ca00, rc 0) 00000100:00080000:2.0:1788638537.368387:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638537.369532:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:10250:x1875523174163840:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 1615us (1793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638537.369542:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 32 00000100:00100000:0.0:1788638537.384018:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638537.384102:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174163968 00000100:00100000:1.0:1788638537.384112:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174163968 00000100:00100000:1.0:1788638537.384171:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 33 00000100:00100000:1.0:1788638537.384181:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+6:10251:x1875523174163968:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788638537.384200:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638537.384220:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2aa89 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434e00 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.384281:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2aa90 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.384295:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2aa90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.384306:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2aa90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.384320:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa97 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.384503:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.384513:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.384723:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2aa9e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.384732:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2aa9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.384847:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2aa9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788638537.384876:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788638537.384879:0:7634:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788638537.384900:0:7634:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2aa9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.384910:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2aa90 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.384916:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2aa90 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.384922:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2aa90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.384928:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638537.384931:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2aa90 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.384938:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2aa90 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.384948:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:1.0:1788638537.384952:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638537.384957:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2aa90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.384963:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2aa90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.384985:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa97 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.384992:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa97 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.384997:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.385002:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638537.385006:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa97 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.385012:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa97 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.385020:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c7398420b00) 00010000:00010000:1.0:1788638537.385022:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638537.385025:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa97 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.385030:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2aa97 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.385062:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2aa89 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e00 expref: 8 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.385076:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2aa9e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e00 expref: 7 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638537.385093:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c7398420300) 00010000:00010000:1.0:1788638537.385095:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788638537.385098:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385308800, rc 0) 00000100:00100000:1.0:1788638537.385215:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+7:10251:x1875523174163968:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 1035us (1205us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638537.385223:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 33 00000100:00100000:1.0:1788638537.396283:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638537.396376:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174164224 00000100:00100000:0.0:1788638537.396386:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174164224 00000100:00100000:0.0:1788638537.396447:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 34 00000100:00100000:0.0:1788638537.396458:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+7:10251:x1875523174164224:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788638537.396479:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638537.396499:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2aaa5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434e07 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.396573:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aaac lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.396589:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aaac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.396600:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aaac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.396664:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2aab3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.396673:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2aab3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.396694:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2aab3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.397178:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c400/0xa0b1f1e3b4b2aaba lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.397187:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c400/0xa0b1f1e3b4b2aaba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.397193:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c400/0xa0b1f1e3b4b2aaba lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638537.397202:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788638537.397333:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aaac lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.397340:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aaac lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.397346:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aaac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.397352:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01dc00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638537.397356:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aaac lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.397374:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aaac lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.397387:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c7398420300) 00010000:00010000:0.0:1788638537.397391:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638537.397403:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aaac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.397410:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aaac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.397435:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2aab3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.397442:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2aab3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.397448:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2aab3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.397453:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638537.397456:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2aab3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.397461:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2aab3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.397469:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c73a1cf7f00) 00010000:00010000:0.0:1788638537.397471:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638537.397474:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2aab3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.397480:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2aab3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.399304:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2aaa5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e07 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.399360:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c400/0xa0b1f1e3b4b2aaba lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e07 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638537.399378:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c73a1cf7600) 00010000:00010000:0.0:1788638537.399382:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638537.399385:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01c400, rc 0) 00000100:00100000:0.0:1788638537.399454:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+9:10251:x1875523174164224:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 2997us (3180us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788638537.399463:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 34 00000100:00100000:2.0:1788638537.406305:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638537.406397:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174164352 00000100:00100000:0.0:1788638537.406408:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174164352 00000100:00100000:0.0:1788638537.406467:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 35 00000100:00100000:0.0:1788638537.406476:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+9:10251:x1875523174164352:12345-192.168.203.34@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788638537.406584:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+9:10251:x1875523174164352:12345-192.168.203.34@tcp:59:lhsmtool_posix.0 Request processed in 108us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638537.406591:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 35 00010000:00010000:0.0:1788638537.631893:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788638537.763209:0:11706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788638537.952459:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bbb7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183639680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788638537.952533:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638537.952607:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183639680 00000100:00100000:1.0:1788638537.952615:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183639680 00000100:00100000:1.0:1788638537.952679:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788638537.952689:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183639680:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788638537.952704:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1788638537.952733:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788638537.952804:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183639680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638537.952812:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1788638537.952834:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73bbb7ad80 x1875523183639680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638553 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638537.952853:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bbb7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183639680:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788638537.990294:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638537.990331:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638537.990353:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638537.990394:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174164480 00000100:00100000:2.0:1788638537.990403:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174164480 00000100:00100000:2.0:1788638537.990451:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 288 00000100:00100000:2.0:1788638537.990460:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:2367:x1875523174164480:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638537.990525:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383685050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:2367:x1875523174164480:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 67us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638537.990532:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 288 00000100:00100000:2.0:1788638537.991192:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174164608 00000100:00100000:2.0:1788638537.991198:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174164608 00000100:00100000:2.0:1788638537.991232:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174164736 00000100:00100000:2.0:1788638537.991236:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174164736 00000100:00100000:2.0:1788638537.991267:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 135 00000100:00100000:2.0:1788638537.991275:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+9:2367:x1875523174164608:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638537.991318:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+9:2367:x1875523174164608:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 43us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638537.991325:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 135 00000100:00100000:2.0:1788638537.991338:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 136 00000100:00100000:2.0:1788638537.991345:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2367:x1875523174164736:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638537.991381:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2367:x1875523174164736:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 36us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638537.991387:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 136 00000100:00080000:3.0:1788638537.993414:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788638538.656136:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638539.677573:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638539.677663:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174164864 00000100:00100000:3.0:1788638539.677674:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174164864 00000100:00100000:3.0:1788638539.677766:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 36 00000100:00100000:3.0:1788638539.677802:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+9:10293:x1875523174164864:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:3.0:1788638539.677824:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638539.677846:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2aac8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434e0e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.677926:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2aacf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.677941:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2aacf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.677955:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2aacf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.677971:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2aad6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.677979:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2aad6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.677985:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2aad6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788638539.678093:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788638539.684443:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638539.684984:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2aacf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.684997:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2aacf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.685004:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2aacf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.685011:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638539.685015:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2aacf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.685035:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2aacf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.685049:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:3.0:1788638539.685051:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638539.685056:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2aacf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.685063:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2aacf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.685075:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2aad6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.685081:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2aad6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.685086:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2aad6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.685091:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638539.685094:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2aad6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.685100:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2aad6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.685106:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c7393e81800) 00010000:00010000:3.0:1788638539.685109:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638539.685112:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2aad6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.685126:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2aad6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.685172:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2aac8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e0e expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.685182:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:3.0:1788638539.685185:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638539.685188:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2aac8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e0e expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.685196:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030e00, rc 0) 00000100:00100000:3.0:1788638539.685729:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+9:10293:x1875523174164864:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 7951us (8164us total) trans 0 rc 301/301 00000100:00100000:3.0:1788638539.685738:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 36 00000100:00100000:1.0:1788638539.713581:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638539.713706:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174165120 00000100:00100000:0.0:1788638539.713717:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174165120 00000100:00100000:0.0:1788638539.713767:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 37 00000100:00100000:0.0:1788638539.713778:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+9:10293:x1875523174165120:12345-192.168.203.34@tcp:36:lfs.0 00010000:00010000:0.0:1788638539.713857:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638539.713882:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2aa82 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434df9 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.713907:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:0.0:1788638539.713918:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788638539.714115:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aadd lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.714130:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aadd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.714138:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aadd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.714149:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aae4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.714156:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aae4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.714162:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aae4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638539.715110:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788638539.715123:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aadd lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.715132:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aadd lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.715138:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aadd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.715144:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01dc00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638539.715154:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aadd lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.715162:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aadd lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.715175:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a1cf7f00) 00010000:00010000:0.0:1788638539.715178:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638539.715182:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aadd lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.715189:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aadd lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788638539.715207:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000097ab8305 reply state 00000000e4424c05 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aae4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638539.715215:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788638539.715321:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+10:10293:x1875523174165120:12345-192.168.203.34@tcp:36:lfs.0 Request processed in 1544us (1747us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788638539.715329:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 37 00010000:00010000:0.0:1788638539.721808:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aae4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.721823:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aae4 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.721831:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aae4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.721838:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638539.721843:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aae4 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.721882:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aae4 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.721897:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c73a1cf7a00) 00010000:00010000:0.0:1788638539.721900:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638539.721905:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aae4 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.721912:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aae4 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638539.881722:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638539.881833:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174165248 00000100:00100000:2.0:1788638539.881857:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174165248 00000100:00100000:0.0:1788638539.881991:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 38 00000100:00100000:0.0:1788638539.882004:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+9:10301:x1875523174165248:12345-192.168.203.34@tcp:101:lctl.0 00010000:00010000:0.0:1788638539.882030:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638539.882054:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aaeb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434e15 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.882120:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aaf2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.882135:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aaf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.882146:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aaf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638539.882192:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788638539.882196:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638539.882232:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aaf2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.882262:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aaeb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e15 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.882280:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aaf2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e15 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.882289:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:0.0:1788638539.882291:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788638539.882295:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01dc00, rc 0) 00000100:00100000:0.0:1788638539.882372:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+10:10301:x1875523174165248:12345-192.168.203.34@tcp:101:lctl.0 Request processed in 371us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638539.882380:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 38 00000100:00100000:2.0:1788638539.958502:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638539.958675:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174165376 00000100:00100000:0.0:1788638539.958686:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174165376 00000100:00100000:0.0:1788638539.958746:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 39 00000100:00100000:0.0:1788638539.958757:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+10:10307:x1875523174165376:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:0.0:1788638539.958780:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638539.958841:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aaf9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434e1c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.958909:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ab00 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.958925:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ab00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.958938:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ab00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.958967:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2ab07 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.958975:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2ab07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.958982:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2ab07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.959073:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c000/0xa0b1f1e3b4b2ab0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.959082:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c000/0xa0b1f1e3b4b2ab0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.959089:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c000/0xa0b1f1e3b4b2ab0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638539.959116:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788638539.959121:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638539.959156:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c000/0xa0b1f1e3b4b2ab0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.959169:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ab00 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.959176:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ab00 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.959183:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ab00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.959199:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01ca00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638539.959204:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ab00 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.959211:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ab00 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.959224:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:0.0:1788638539.959227:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638539.959231:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ab00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.959237:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ab00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.959252:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2ab07 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.959258:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2ab07 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.959264:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2ab07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.959268:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01ce00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638539.959271:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2ab07 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.959277:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2ab07 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.959296:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9c73a1cf7f00) 00010000:00010000:0.0:1788638539.959299:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638539.959301:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2ab07 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.959307:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2ab07 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.959363:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aaf9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e1c expref: 12 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.959378:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c000/0xa0b1f1e3b4b2ab0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e1c expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.959385:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:0.0:1788638539.959387:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788638539.959390:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01c000, rc 0) 00000100:00100000:0.0:1788638539.959440:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+11:10307:x1875523174165376:12345-192.168.203.34@tcp:101:bash.0 Request processed in 685us (947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638539.959447:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 39 00000100:00100000:2.0:1788638539.968576:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638539.968835:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174165632 00000100:00100000:3.0:1788638539.968846:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174165632 00000100:00100000:3.0:1788638539.968896:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 40 00000100:00100000:3.0:1788638539.968906:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+11:10307:x1875523174165632:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:3.0:1788638539.968935:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638539.968958:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2ab15 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434e23 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.969404:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2ab1c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.969419:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2ab1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.969444:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2ab1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.969618:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2ab23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.969628:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2ab23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.969635:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2ab23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788638539.972036:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1788638539.972676:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ab2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.972693:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ab2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.972768:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ab2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.972877:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2ab1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.972885:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2ab1c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.972892:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2ab1c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.972898:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638539.972910:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2ab1c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.972919:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2ab1c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.972997:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:3.0:1788638539.973000:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638539.973004:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2ab1c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.973011:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2ab1c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788638539.973027:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc21ec95 reply state 000000002d7d1e9d transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2ab23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638539.973036:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788638539.973256:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2ab15 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e23 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.973274:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ab2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e23 expref: 13 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638539.973282:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81500) 00010000:00010000:3.0:1788638539.973285:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788638539.973288:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030400, rc 0) 00000100:00100000:3.0:1788638539.973697:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+14:10307:x1875523174165632:12345-192.168.203.34@tcp:101:bash.0 Request processed in 4790us (5128us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788638539.973715:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 40 00010000:00010000:0.0:1788638539.985026:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2ab23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.985044:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2ab23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.985052:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2ab23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.985075:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638539.985080:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2ab23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.985690:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2ab23 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.985711:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c7393e81800) 00010000:00010000:0.0:1788638539.985714:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638539.985719:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2ab23 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638539.985727:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2ab23 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638539.985849:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638539.986912:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174165760 00000100:00100000:3.0:1788638539.986983:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174165760 00000100:00100000:3.0:1788638539.987066:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 20 00000100:00100000:3.0:1788638539.987083:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2363:x1875523174165760:12345-192.168.203.34@tcp:8:bash.0 00010000:00080000:3.0:1788638539.987114:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp t0 exp 0000000000000000 cur 303 last 0 00000020:00000080:3.0:1788638539.987156:0:6687:0:(genops.c:1385:class_connect()) connect: client 00196f64-ae55-4ffc-b84c-468028ab3a77, cookie 0xa0b1f1e3b4b2ab38 00002000:00100000:3.0:1788638539.987168:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 00196f64-ae55-4ffc-b84c-468028ab3a77/ffff9c73bc015000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788638539.987202:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type 37, return 37 00002000:00080000:3.0:1788638539.987452:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788638539.987508:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9c73bc010800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788638539.987590:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2363:x1875523174165760:12345-192.168.203.34@tcp:8:bash.0 Request processed in 506us (1744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638539.987599:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 20 00000100:00100000:2.0:1788638539.994557:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638540.001575:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bbb7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183639808:0@lo:400:kworker.0 00000100:00100000:2.0:1788638540.001653:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638540.001742:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bbb79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183639936:0@lo:400:kworker.0 00000100:00100000:3.0:1788638540.001775:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638540.002147:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183640320:0@lo:400:kworker.0 00000100:00100000:2.0:1788638540.002175:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638540.002234:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183639808 00000100:00100000:2.0:1788638540.002242:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183639808 00000100:00100000:2.0:1788638540.002288:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788638540.002298:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183639808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638540.002870:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383685850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183639808:12345-0@lo:400:kworker.0 Request processed in 572us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638540.002878:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1788638540.002917:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183639936 00000100:00100000:2.0:1788638540.002931:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183639936 00000100:00100000:2.0:1788638540.002957:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183640320 00000100:00100000:2.0:1788638540.002960:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183640320 00000100:00100000:2.0:1788638540.002985:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788638540.002992:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183639936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638540.003028:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183639936:12345-0@lo:400:kworker.0 Request processed in 37us (1252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638540.003034:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788638540.003044:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788638540.003050:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183640320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638540.003099:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183640320:12345-0@lo:400:kworker.0 Request processed in 50us (923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638540.003106:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:2.0:1788638540.003121:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638540.003151:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bbb7ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183639808:0@lo:400:kworker.0 00000100:00100000:2.0:1788638540.003166:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183640320:0@lo:400:kworker.0 00000100:00100000:3.0:1788638540.003383:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bbb79f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183639936:0@lo:400:kworker.0 00000100:00100000:3.0:1788638540.003392:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183640448:0@lo:400:kworker.0 00000100:00100000:3.0:1788638540.003419:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638540.003463:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183640192:0@lo:400:kworker.0 00000100:00100000:3.0:1788638540.003498:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638540.003517:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788638540.003522:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bbb78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183640064:0@lo:400:kworker.0 00000100:00100000:3.0:1788638540.003553:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638540.003575:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174165888 00000100:00100000:3.0:1788638540.003579:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174165888 00000100:00100000:3.0:1788638540.003609:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183640448 00000100:00100000:3.0:1788638540.003612:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183640448 00000100:00100000:3.0:1788638540.003625:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183640192 00000100:00100000:3.0:1788638540.003627:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183640192 00000100:00100000:3.0:1788638540.003641:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788638540.003647:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183640448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638540.003681:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183640448:12345-0@lo:400:kworker.0 Request processed in 34us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638540.003688:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788638540.003699:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788638540.003871:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183640192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638540.003903:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183640192:12345-0@lo:400:kworker.0 Request processed in 199us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638540.003909:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788638540.003933:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 21 00000100:00100000:3.0:1788638540.003939:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:0:x1875523174165888:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:3.0:1788638540.003949:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638540.003968:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2ab3f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434e2a expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788638540.003992:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788638540.004006:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=303s v=(0 0) 00010000:00010000:3.0:1788638540.004010:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788638540.004019:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2ab3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e2a expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.004037:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2ab3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e2a expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.004055:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030e00, rc 0) 00000100:00100000:3.0:1788638540.004098:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+7:0:x1875523174165888:12345-192.168.203.34@tcp:101:bash.0 Request processed in 159us (9549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638540.004104:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 21 00010000:00080000:3.0:1788638540.004131:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b7c44700 x1875523183640192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788638556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638540.004141:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183640192:0@lo:400:kworker.0 00000100:00100000:3.0:1788638540.004160:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183640448:0@lo:400:kworker.0 00000100:00100000:3.0:1788638540.004173:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183640064 00000100:00100000:3.0:1788638540.004176:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183640064 00000100:00100000:3.0:1788638540.004342:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788638540.004360:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183640064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638540.004396:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183640064:12345-0@lo:400:kworker.0 Request processed in 38us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638540.004402:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788638540.004424:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bbb78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183640064:0@lo:400:kworker.0 00000100:00080000:2.0:1788638540.004719:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788638540.004723:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788638540.004725:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788638540.014192:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638540.014355:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174166016 00000100:00100000:3.0:1788638540.014365:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174166016 00000100:00100000:3.0:1788638540.014421:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 22 00000100:00100000:3.0:1788638540.014431:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+7:10307:x1875523174166016:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:3.0:1788638540.014449:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638540.014475:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2ab46 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434e31 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.014689:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2ab3f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e2a expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.014699:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788638540.014703:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788638540.014718:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2ab46 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e31 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.014753:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2ab3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e2a expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.014767:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2ab3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e2a expref: 8 pid: 6687 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638540.014827:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7391b49880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1875523183640576:192.168.203.34@tcp:104: 00000100:00100000:3.0:1788638540.014905:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bc01a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788638540.019465:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7391b49880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1875523183640576:192.168.203.34@tcp:104: 00010000:00010000:3.0:1788638540.019566:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2ab46 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e31 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.019586:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030000, rc 0) 00000100:00100000:3.0:1788638540.019670:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+8:10307:x1875523174166016:12345-192.168.203.34@tcp:101:bash.0 Request processed in 5240us (5487us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638540.019679:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 22 00000100:00100000:2.0:1788638540.025049:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638540.025698:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174166144 00000100:00100000:3.0:1788638540.025800:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174166144 00010000:00010000:3.0:1788638540.025846:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2ab3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e2a expref: 8 pid: 6687 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638540.025988:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 35 00000100:00100000:3.0:1788638540.025999:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2365:x1875523174166144:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788638540.026015:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638540.026039:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2ab3f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e2a expref: 8 pid: 6687 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.026054:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2ab3f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e2a expref: 8 pid: 6687 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.026087:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2ab3f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e2a expref: 8 pid: 6687 timeout: 403 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.026106:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788638540.026111:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788638540.026120:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2ab46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e31 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.026130:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2ab46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e31 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.026353:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2ab46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e31 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638540.026382:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7391b49880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1875523183640704:192.168.203.34@tcp:105: 00000100:00100000:3.0:1788638540.026991:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bc01a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788638540.032970:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7391b49880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1875523183640704:192.168.203.34@tcp:105: 00010000:00010000:3.0:1788638540.033000:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638540.033059:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2365:x1875523174166144:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 7061us (8017us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638540.033078:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 35 00000100:00100000:3.0:1788638540.039681:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638540.040092:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174166400 00000100:00100000:2.0:1788638540.040102:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174166400 00000100:00100000:2.0:1788638540.040165:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00100000:2.0:1788638540.040174:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+13:10307:x1875523174166400:12345-192.168.203.34@tcp:35:bash.0 00000100:00100000:2.0:1788638540.041092:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b49880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+14:10307:x1875523174166400:12345-192.168.203.34@tcp:35:bash.0 Request processed in 914us (1415us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788638540.041104:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00100000:2.0:1788638540.157312:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638540.157434:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174166656 00000100:00100000:3.0:1788638540.157445:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174166656 00000100:00100000:3.0:1788638540.157659:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 41 00000100:00100000:3.0:1788638540.157671:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+14:10318:x1875523174166656:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:3.0:1788638540.157696:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638540.157728:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2ab4d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434e38 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638540.157848:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788638540.158051:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2ab4d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e38 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.158065:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:2.0:1788638540.158068:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788638540.158074:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2ab4d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e38 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.158111:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030e00, rc 0) 00000100:00100000:2.0:1788638540.158169:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+15:10318:x1875523174166656:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 501us (869us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788638540.158177:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 41 00000100:00100000:0.0:1788638540.162892:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638540.162977:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174166912 00000100:00100000:3.0:1788638540.162988:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174166912 00000100:00100000:3.0:1788638540.163046:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 7 00000100:00100000:3.0:1788638540.163057:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+15:10318:x1875523174166912:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:3.0:1788638540.163437:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+16:10318:x1875523174166912:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 380us (552us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788638540.163445:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 7 00000100:00100000:3.0:1788638540.256244:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638540.256697:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174167040 00000100:00100000:0.0:1788638540.256717:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174167040 00000100:00100000:0.0:1788638540.256776:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 42 00000100:00100000:0.0:1788638540.257035:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+16:10324:x1875523174167040:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638540.257065:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638540.257086:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ab5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434e3f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.257165:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2ab62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.257178:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2ab62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.257208:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2ab62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638540.257243:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788638540.257247:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638540.257265:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2ab62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.257291:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ab5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e3f expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.257320:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2ab62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e3f expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.257329:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:0.0:1788638540.257332:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788638540.257336:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01da00, rc 0) 00000100:00100000:0.0:1788638540.257719:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+17:10324:x1875523174167040:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 932us (1482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638540.257727:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 42 00000100:00100000:2.0:1788638540.262471:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638540.262696:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174167296 00000100:00100000:0.0:1788638540.262775:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174167296 00000100:00100000:0.0:1788638540.262957:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 43 00000100:00100000:0.0:1788638540.262968:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+17:10324:x1875523174167296:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638540.262989:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638540.263011:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ab69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434e46 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.263133:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2ab70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.263219:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2ab70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.263234:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2ab70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638540.263246:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788638540.263490:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ab69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e46 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.263509:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2ab70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e46 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.263518:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81500) 00010000:00010000:0.0:1788638540.263521:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788638540.263524:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01d800, rc 0) 00000100:00100000:0.0:1788638540.264012:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+19:10324:x1875523174167296:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 1044us (1548us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788638540.264019:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 43 00000100:00100000:2.0:1788638540.271353:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638540.271494:0:11689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174167424 00000100:00100000:3.0:1788638540.271504:0:11689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174167424 00000100:00100000:3.0:1788638540.271636:0:11689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 2 00000100:00100000:3.0:1788638540.271649:0:11689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+19:2365:x1875523174167424:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788638540.271666:0:11689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638540.271690:0:11689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2ab70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e46 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.271719:0:11689:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81500) 00010000:00010000:3.0:1788638540.271724:0:11689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638540.272837:0:11689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+18:2365:x1875523174167424:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 1182us (1494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638540.272848:0:11689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 2 00000100:00100000:3.0:1788638540.274910:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638540.275891:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174167680 00000100:00100000:2.0:1788638540.275904:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174167680 00000100:00100000:2.0:1788638540.276374:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 44 00000100:00100000:2.0:1788638540.276386:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+18:10324:x1875523174167680:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:2.0:1788638540.276410:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638540.276540:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2ab7e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434e4d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.276634:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ab85 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.276648:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ab85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.276985:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ab85 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638540.277001:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788638540.277182:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2ab7e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e4d expref: 21 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.277286:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ab85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e4d expref: 20 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.277295:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81500) 00010000:00010000:2.0:1788638540.277298:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788638540.277301:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7000, rc 0) 00000100:00100000:2.0:1788638540.277422:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+20:10324:x1875523174167680:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 1038us (2520us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788638540.277430:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 44 00000100:00100000:0.0:1788638540.284441:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638540.286536:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174167808 00000100:00100000:1.0:1788638540.286550:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174167808 00000100:00100000:1.0:1788638540.286631:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 23 00000100:00100000:1.0:1788638540.286642:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2364:x1875523174167808:12345-192.168.203.34@tcp:1:lfs.0 00010000:00010000:1.0:1788638540.286693:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2ab93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638540.286732:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2ab46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e31 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638540.286741:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638540.286746:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788638540.286752:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2ab93 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638540.286809:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2ab46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e31 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638540.286823:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2ab46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e31 expref: 7 pid: 6687 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638540.286839:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c29f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6684:1875523183640832:192.168.203.34@tcp:104: 00000100:00100000:1.0:1788638540.286947:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387969f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788638540.299869:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c29f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6684:1875523183640832:192.168.203.34@tcp:104: 00010000:00010000:1.0:1788638540.299901:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2ab93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638540.301468:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638540.302019:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174167936 00000100:00100000:3.0:1788638540.302093:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174167936 00002000:00100000:3.0:1788638540.302213:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9c7398c2e680 x1875523174167936/t0(0) o4->00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp:516/0 lens 504/0 e 0 to 0 dl 1788638551 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788638540.302278:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7398c2e680 with x1875523174167936 ext(0->12) 00010000:00010000:3.0:1788638540.302291:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2ab46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e31 expref: 8 pid: 6687 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.302385:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2ab46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e31 expref: 8 pid: 6687 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788638540.302395:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c7398c2e680 00000100:00100000:3.0:1788638540.302446:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 0 00000100:00100000:3.0:1788638540.302456:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2365:x1875523174167936:12345-192.168.203.34@tcp:4:lfs.0 00000001:00100000:1.0:1788638540.349682:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 00196f64-ae55-4ffc-b84c-468028ab3a77 00000001:00080000:1.0:1788638540.392110:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1788638540.392110:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+9:2365:x1875523174167936:12345-192.168.203.34@tcp:4:lfs.0 Request processed in 89644us (90640us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788638540.392128:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 0 00002000:00100000:0.0:1788638540.392153:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9c7398c2e680 x1875523174167936/t4294967299(0) o4->00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp:516/0 lens 504/448 e 0 to 0 dl 1788638551 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788638540.392163:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7398c2e680 with x1875523174167936 ext(0->12) 00010000:00010000:0.0:1788638540.392172:0:6690:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2ab46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e31 expref: 7 pid: 6687 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.392187:0:6690:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2ab46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e31 expref: 7 pid: 6687 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788638540.392195:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c7398c2e680 00000100:00100000:3.0:1788638540.395116:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638540.395334:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174168064 00000100:00100000:0.0:1788638540.395353:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174168064 00010000:00010000:0.0:1788638540.395392:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2ab46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e31 expref: 7 pid: 6687 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638540.395434:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 36 00000100:00100000:0.0:1788638540.395444:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2364:x1875523174168064:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788638540.395458:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788638540.395477:0:5829:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788638540.395480:0:5829:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788638540 00002000:00010000:0.0:1788638540.395482:0:5829:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788638540 00002000:00010000:0.0:1788638540.395483:0:5829:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788638540 00002000:00010000:0.0:1788638540.395485:0:5829:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1788638540.395492:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2ab46 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e31 expref: 7 pid: 6687 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.395526:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2ab46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e31 expref: 7 pid: 6687 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.395551:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2ab46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e31 expref: 7 pid: 6687 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.395570:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788638540.395574:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788638540.395580:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2ab93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.395590:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2ab93 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.395622:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638540.395675:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174168064:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 232us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638540.395682:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 36 00010000:00010000:1.0:1788638540.396055:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2ab93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638540.396077:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2ab93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638540.396101:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2ab93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638540.396109:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2ab93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638540.396116:0:6684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2ab93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638540.396122:0:6684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308c00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638540.396126:0:6684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2ab93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638540.396134:0:6684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2ab93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638540.396146:0:6684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2ab93 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638540.396153:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000997fd28b/0xa0b1f1e3b4b2ab93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638540.396237:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2364:x1875523174167808:12345-192.168.203.34@tcp:1:lfs.0 Request processed in 109597us (111807us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638540.396245:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 23 00000100:00100000:3.0:1788638540.398816:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638540.399027:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174168320 00000100:00100000:2.0:1788638540.399037:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174168320 00000100:00100000:2.0:1788638540.399088:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:2.0:1788638540.399097:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+20:10324:x1875523174168320:12345-192.168.203.34@tcp:35:lfs.0 00000004:00010000:2.0:1788638540.399158:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ab85 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e4d expref: 20 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788638540.399692:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1788638540.399858:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1788638540.400511:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1788638540.400567:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2ab9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.400585:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ab2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e23 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.400594:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2ab9a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.400641:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ab2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e23 expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.400658:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ab2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e23 expref: 24 pid: 5842 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638540.400672:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7da3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1875523183640960:192.168.203.34@tcp:104: 00000100:00100000:2.0:1788638540.400864:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d906c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638540.403926:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7da3800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1875523183640960:192.168.203.34@tcp:104: 00010000:00010000:0.0:1788638540.403958:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2ab9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638540.405316:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638540.405480:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174168448 00000100:00100000:2.0:1788638540.405488:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174168448 00010000:00010000:2.0:1788638540.405530:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ab2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e23 expref: 25 pid: 5842 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638540.405570:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 37 00000100:00100000:2.0:1788638540.405580:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+25:2365:x1875523174168448:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638540.405595:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638540.405602:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ab2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e23 expref: 25 pid: 5842 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.405614:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ab2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e23 expref: 25 pid: 5842 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.405636:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ab2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e23 expref: 25 pid: 5842 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.405653:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81500) 00010000:00010000:2.0:1788638540.405668:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2ab9a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.405677:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2ab9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.405684:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2ab9a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.405715:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638540.405778:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+24:2365:x1875523174168448:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 199us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638540.405824:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 37 00010000:00010000:0.0:1788638540.405937:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2ab9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.405945:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2ab9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788638540.406078:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788638540.406273:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1788638540.406418:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7398c2ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875523183641088:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788638540.406506:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638540.406542:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387973000 going to sleep for 11 seconds 00000100:00100000:3.0:1788638540.406672:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183641088 00000100:00100000:3.0:1788638540.406678:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183641088 00000100:00100000:3.0:1788638540.406717:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638540.406724:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875523183641088:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788638540.406826:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875523183641088:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 102us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638540.406833:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788638540.406942:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7398c2ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875523183641088:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788638540.407561:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788638540.407623:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7da2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875523183641216:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788638540.407661:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638540.407677:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d900c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638540.408025:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183641216 00000100:00100000:3.0:1788638540.408032:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183641216 00000100:00100000:3.0:1788638540.408060:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788638540.408066:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875523183641216:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788638540.409523:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5845:x1875523183641216:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 1449us (1854us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788638540.409537:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638540.409862:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7da2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875523183641216:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788638540.409936:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1788638540.409984:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2ab9a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.409994:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2ab9a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.410001:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2ab9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.410006:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638540.410011:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2ab9a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.410018:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2ab9a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.410032:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81500) 00010000:00010000:0.0:1788638540.410035:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788638540.410040:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2ab9a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.410046:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2ab9a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788638540.410296:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788638540.410528:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788638540.410541:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 303481757291ns, next at 304481754526ns, rc = 0 00000001:00080000:0.0:1788638540.410548:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1788638540.410581:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81500) 00010000:00010000:0.0:1788638540.410585:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788638540.410592:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ab85 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e4d expref: 28 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638540.414115:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+27:10324:x1875523174168320:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 15005us (15326us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788638540.414130:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 8 00000020:00080000:0.0:1788638540.414138:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788638540.418339:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638540.418460:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174168576 00000100:00100000:2.0:1788638540.418470:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174168576 00000100:00100000:2.0:1788638540.418562:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 45 00000100:00100000:2.0:1788638540.418573:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+27:10324:x1875523174168576:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:2.0:1788638540.418599:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638540.418623:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2aba1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434e54 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.418681:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2aba1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e54 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.418711:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2aba1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e54 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.418732:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:2.0:1788638540.418736:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788638540.418739:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6400, rc 0) 00000100:00100000:2.0:1788638540.418830:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b48000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+28:10324:x1875523174168576:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 259us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638540.418837:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 45 00000100:00100000:1.0:1788638540.425063:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638540.425219:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174168832 00000100:00100000:3.0:1788638540.425229:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174168832 00000100:00100000:3.0:1788638540.425280:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:3.0:1788638540.425290:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73a5714850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+28:10324:x1875523174168832:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:3.0:1788638540.425530:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73a5714850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+29:10324:x1875523174168832:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 240us (472us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788638540.425554:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:3.0:1788638540.512733:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7398c2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183641344:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788638540.512826:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638540.513038:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183641344 00000100:00100000:0.0:1788638540.513049:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183641344 00000100:00100000:0.0:1788638540.513106:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788638540.513115:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183641344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788638540.513147:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638540.513200:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183641344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638540.513207:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788638540.513569:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7398c2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183641344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788638540.574951:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638540.575092:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174169088 00000100:00100000:0.0:1788638540.575102:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174169088 00000100:00100000:0.0:1788638540.575161:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 46 00000100:00100000:0.0:1788638540.575169:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+29:10334:x1875523174169088:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638540.575193:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638540.575224:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2aba8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434e5b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638540.575519:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788638540.575634:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2aba8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e5b expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.575649:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:0.0:1788638540.575651:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788638540.575657:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2aba8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e5b expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638540.575670:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01d200, rc 0) 00000100:00100000:0.0:1788638540.575774:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+30:10334:x1875523174169088:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 598us (828us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1788638540.575819:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 46 00000100:00100000:0.0:1788638540.580853:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638540.580948:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174169216 00000100:00100000:3.0:1788638540.580958:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174169216 00000100:00100000:3.0:1788638540.581006:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 47 00000100:00100000:3.0:1788638540.581015:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+30:10334:x1875523174169216:12345-192.168.203.34@tcp:34:lfs.0 00010000:00010000:3.0:1788638540.581088:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2abb6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581105:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2abb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581117:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2abb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581132:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2abbd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581140:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2abbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581147:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2abbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581230:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2abc4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581254:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2abc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581261:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2abc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788638540.581311:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2abc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581326:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2abb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581332:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2abb6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581338:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2abb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581354:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638540.581358:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2abb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581366:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2abb6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581377:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:3.0:1788638540.581381:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638540.581385:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2abb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581391:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2abb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581412:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2abbd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581418:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2abbd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581424:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2abbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581428:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638540.581431:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2abbd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581437:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2abbd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581445:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c7393e81100) 00010000:00010000:3.0:1788638540.581448:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638540.581450:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2abbd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581456:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2abbd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581469:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2abc4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581476:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2abc4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581482:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2abc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581493:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638540.581496:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2abc4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581503:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2abc4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581512:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:3.0:1788638540.581514:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638540.581517:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2abc4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.581522:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2abc4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638540.581592:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+30:10334:x1875523174169216:12345-192.168.203.34@tcp:34:lfs.0 Request processed in 577us (749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638540.581601:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 47 00000100:00100000:1.0:1788638540.584637:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638540.584717:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174169472 00000100:00100000:0.0:1788638540.584727:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174169472 00000100:00100000:0.0:1788638540.584778:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:0.0:1788638540.584812:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+30:10334:x1875523174169472:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:0.0:1788638540.585051:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+31:10334:x1875523174169472:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 242us (425us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788638540.585060:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:1.0:1788638540.642108:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638540.642200:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174169728 00000100:00100000:2.0:1788638540.642210:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174169728 00000100:00100000:2.0:1788638540.642273:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 48 00000100:00100000:2.0:1788638540.642284:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+31:10337:x1875523174169728:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:2.0:1788638540.642317:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638540.642339:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2abcb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434e62 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642451:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2abd2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642466:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2abd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642477:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2abd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642491:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2abd9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642505:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2abd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642511:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2abd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642627:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2abe0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642636:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2abe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642643:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2abe0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638540.642653:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788638540.642748:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2abd2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642756:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2abd2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642762:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2abd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642767:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638540.642772:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2abd2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642815:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2abd2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642839:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:2.0:1788638540.642841:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638540.642847:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2abd2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642854:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2abd2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642868:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2abd9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642873:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2abd9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642879:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2abd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642884:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638540.642886:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2abd9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642891:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2abd9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642897:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c738a6e9c00) 00010000:00010000:2.0:1788638540.642899:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638540.642902:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2abd9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642907:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2abd9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642971:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2abcb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e62 expref: 34 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642984:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2abe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e62 expref: 33 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638540.642992:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:2.0:1788638540.642994:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788638540.642997:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6600, rc 0) 00000100:00100000:2.0:1788638540.643057:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+33:10337:x1875523174169728:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 775us (956us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788638540.643065:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 48 00000100:00100000:1.0:1788638540.647404:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638540.647551:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174169856 00000100:00100000:3.0:1788638540.647561:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174169856 00000100:00100000:3.0:1788638540.647611:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 49 00000100:00100000:3.0:1788638540.647619:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+33:10337:x1875523174169856:12345-192.168.203.34@tcp:54:lfs.0 00010000:00010000:3.0:1788638540.647680:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2abee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.647695:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2abee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.647707:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2abee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.647744:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2abee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.647751:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2abee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.647757:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2abee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.647772:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638540.647776:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2abee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.647822:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2abee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.647835:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:3.0:1788638540.647838:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788638540.647842:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2abee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638540.647848:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2abee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638540.647920:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+33:10337:x1875523174169856:12345-192.168.203.34@tcp:54:lfs.0 Request processed in 296us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638540.647928:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 49 00000100:00100000:1.0:1788638540.651404:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638540.651572:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174170112 00000100:00100000:0.0:1788638540.651582:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174170112 00000100:00100000:0.0:1788638540.651668:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 11 00000100:00100000:0.0:1788638540.651678:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+33:10337:x1875523174170112:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:0.0:1788638540.651951:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+34:10337:x1875523174170112:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 273us (555us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788638540.651958:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 11 00010000:00010000:0.0:1788638540.704071:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638541.008156:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638541.008292:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174170368 00000100:00100000:2.0:1788638541.008310:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174170368 00000100:00100000:2.0:1788638541.008398:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 50 00000100:00100000:2.0:1788638541.008410:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+34:10368:x1875523174170368:12345-192.168.203.34@tcp:101:cat.0 00010000:00010000:2.0:1788638541.008434:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638541.008457:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2abf5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434e69 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.008558:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2abfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.008572:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2abfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.008585:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2abfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638541.008613:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788638541.008824:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2abf5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e69 expref: 37 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.008844:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2abfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e69 expref: 36 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.008853:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:2.0:1788638541.008856:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788638541.008860:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6000, rc 0) 00000100:00100000:2.0:1788638541.008917:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+36:10368:x1875523174170368:12345-192.168.203.34@tcp:101:cat.0 Request processed in 509us (770us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1788638541.008924:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 50 00000100:00080000:3.0:1788638541.009207:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788638541.017034:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638541.017118:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638541.017210:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174170752 00000100:00100000:0.0:1788638541.017219:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174170752 00000100:00100000:0.0:1788638541.017327:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 3 00000100:00100000:0.0:1788638541.017347:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384df9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+36:2365:x1875523174170752:12345-192.168.203.34@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788638541.017355:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174170624 00000100:00100000:3.0:1788638541.017359:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174170624 00010000:00010000:0.0:1788638541.017362:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638541.017385:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2abfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e69 expref: 37 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.017404:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00000100:00100000:3.0:1788638541.017406:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 12 00010000:00010000:0.0:1788638541.017410:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638541.017413:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+36:10368:x1875523174170624:12345-192.168.203.34@tcp:35:cat.0 00000100:00100000:0.0:1788638541.017837:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384df9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+36:2365:x1875523174170752:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 499us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638541.017844:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 3 00000100:00100000:3.0:1788638541.017999:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+36:10368:x1875523174170624:12345-192.168.203.34@tcp:35:cat.0 Request processed in 586us (972us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1788638541.018005:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00100000:1.0:1788638541.098730:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638541.098876:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174171008 00000100:00100000:3.0:1788638541.098886:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174171008 00000100:00100000:3.0:1788638541.098951:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 51 00000100:00100000:3.0:1788638541.098962:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+36:10374:x1875523174171008:12345-192.168.203.34@tcp:101:dd.0 00010000:00010000:3.0:1788638541.098986:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638541.098989:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788638541.099014:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2ab62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e3f expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638541.099034:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:3.0:1788638541.099039:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788638541.099053:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2ac0a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434e70 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638541.099149:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac11 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638541.099164:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2abe0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e62 expref: 36 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638541.099172:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac11 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638541.099225:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2abe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e62 expref: 36 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638541.099238:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2abe0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e62 expref: 36 pid: 7634 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638541.099253:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7391b4b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875523183641472:192.168.203.34@tcp:104: 00000100:00100000:3.0:1788638541.099362:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bc01a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788638541.101660:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7391b4b480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875523183641472:192.168.203.34@tcp:104: 00010000:00010000:3.0:1788638541.101689:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac11 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638541.110562:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638541.110655:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174171136 00000100:00100000:2.0:1788638541.110673:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174171136 00010000:00010000:2.0:1788638541.110713:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2abe0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e62 expref: 37 pid: 7634 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638541.110754:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 38 00000100:00100000:2.0:1788638541.110763:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc075880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+37:2364:x1875523174171136:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638541.110775:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638541.110807:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2abe0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e62 expref: 37 pid: 7634 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.110820:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2abe0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e62 expref: 37 pid: 7634 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.110858:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2abe0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e62 expref: 37 pid: 7634 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.110873:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:2.0:1788638541.110877:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac11 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.110887:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.110895:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac11 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.110921:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638541.110980:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc075880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+36:2364:x1875523174171136:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 216us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638541.110988:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 38 00010000:00010000:0.0:1788638541.112733:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.112750:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac11 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638541.112773:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788638541.113019:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2ac0a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e70 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.113041:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac11 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e70 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.113063:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:0.0:1788638541.113066:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788638541.113070:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031400, rc 0) 00000100:00100000:0.0:1788638541.113121:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+36:10374:x1875523174171008:12345-192.168.203.34@tcp:101:dd.0 Request processed in 14160us (14402us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788638541.113129:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 51 00000100:00100000:1.0:1788638541.124704:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638541.124822:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174171392 00000100:00100000:2.0:1788638541.124832:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174171392 00000100:00100000:2.0:1788638541.124903:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 52 00000100:00100000:2.0:1788638541.124914:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+36:10374:x1875523174171392:12345-192.168.203.34@tcp:36:dd.0 00010000:00010000:2.0:1788638541.125166:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ac1f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.125183:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ac1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.125195:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ac1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788638541.125267:0:7634:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1788638541.125290:0:7634:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a92c6a2d reply state 00000000edf1b6eb transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ac1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638541.125299:0:7634:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788638541.125398:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+39:10374:x1875523174171392:12345-192.168.203.34@tcp:36:dd.0 Request processed in 486us (703us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1788638541.125405:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 52 00000020:00080000:2.0:1788638541.125410:0:7634:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788638541.130396:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ac1f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.130412:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ac1f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.130420:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ac1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.130426:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638541.130430:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ac1f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.130438:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ac1f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.130455:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:0.0:1788638541.130458:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638541.130463:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ac1f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.130469:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ac1f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638541.467182:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638541.467371:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174171520 00000100:00100000:2.0:1788638541.467381:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174171520 00000100:00100000:2.0:1788638541.467443:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 53 00000100:00100000:2.0:1788638541.467453:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+38:10388:x1875523174171520:12345-192.168.203.34@tcp:101:stat.0 00010000:00010000:2.0:1788638541.467476:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638541.467498:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2ac26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434e77 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.467569:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ac2d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.467584:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ac2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.467595:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ac2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.467610:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ac34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.467638:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ac34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.467645:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ac34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.467726:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2ac3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.467737:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac11 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e70 expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.467746:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2ac3b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.467777:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac11 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e70 expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.467825:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac11 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e70 expref: 39 pid: 5843 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638541.467839:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7da1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875523183641600:192.168.203.34@tcp:104: 00000100:00100000:2.0:1788638541.468170:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d90240 going to sleep for 11 seconds 00000100:00100000:1.0:1788638541.470763:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638541.470884:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174171776 00000100:00100000:0.0:1788638541.470894:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174171776 00000100:00100000:0.0:1788638541.470962:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:0.0:1788638541.470973:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+40:5605:x1875523174171776:12345-192.168.203.34@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788638541.471285:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+41:5605:x1875523174171776:12345-192.168.203.34@tcp:35:ldlm_bl.0 Request processed in 313us (529us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788638541.471292:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:2.0:1788638541.472678:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7da1c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875523183641600:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638541.472707:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2ac3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638541.474169:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638541.474607:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174171904 00000100:00100000:3.0:1788638541.474616:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174171904 00010000:00010000:3.0:1788638541.474656:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac11 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e70 expref: 41 pid: 5843 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638541.474700:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 39 00000100:00100000:3.0:1788638541.474709:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc077480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+41:2364:x1875523174171904:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788638541.475039:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638541.475048:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac11 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e70 expref: 41 pid: 5843 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638541.475063:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac11 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e70 expref: 41 pid: 5843 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638541.475104:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac11 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e70 expref: 41 pid: 5843 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638541.475122:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:3.0:1788638541.475128:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2ac3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638541.475137:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2ac3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638541.475145:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2ac3b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638541.475287:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638541.475361:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc077480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+40:2364:x1875523174171904:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 651us (1208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638541.475369:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 39 00010000:00010000:2.0:1788638541.476541:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2ac3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.476576:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2ac3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638541.476623:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788638541.476627:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788638541.476670:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2ac3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.476685:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2ac3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.476696:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ac2d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.476703:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ac2d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.476710:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ac2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.476717:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638541.476721:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ac2d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.476729:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ac2d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.476742:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:2.0:1788638541.476745:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638541.476749:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ac2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.476766:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ac2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.476780:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ac34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.477118:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ac34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.477124:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ac34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.477129:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638541.477133:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ac34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.477139:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ac34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.477148:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c738a6e9c00) 00010000:00010000:2.0:1788638541.477151:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638541.477154:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ac34 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.477160:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ac34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.477201:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2ac26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e77 expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.477215:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2ac3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e77 expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.477231:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:2.0:1788638541.477234:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788638541.477236:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6000, rc 0) 00000100:00100000:2.0:1788638541.477432:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+39:10388:x1875523174171520:12345-192.168.203.34@tcp:101:stat.0 Request processed in 9968us (10248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638541.477441:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 53 00000100:00100000:1.0:1788638541.578261:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638541.578984:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174172160 00000100:00100000:3.0:1788638541.578997:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174172160 00000100:00100000:3.0:1788638541.579054:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 54 00000100:00100000:3.0:1788638541.579064:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+39:10394:x1875523174172160:12345-192.168.203.34@tcp:36:truncate.0 00010000:00010000:3.0:1788638541.579119:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638541.579146:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2ac3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e77 expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638541.579171:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:3.0:1788638541.579176:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788638541.579507:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac42 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638541.579521:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638541.579532:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788638541.579585:0:7634:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1788638541.579610:0:7634:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003f685800 reply state 00000000f90b6b06 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638541.579619:0:7634:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788638541.579736:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+41:10394:x1875523174172160:12345-192.168.203.34@tcp:36:truncate.0 Request processed in 672us (1484us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1788638541.579743:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 54 00000020:00080000:3.0:1788638541.579747:0:7634:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788638541.584366:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac42 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638541.584384:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac42 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638541.584398:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638541.584428:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638541.584433:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac42 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638541.584441:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac42 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638541.584464:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:1.0:1788638541.584467:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638541.584471:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac42 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638541.584477:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ac42 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788638541.614136:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967336 is committed 00000004:00080000:0.0:1788638541.614160:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788638541.614396:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788638541.614413:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7da1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183641728:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788638541.614473:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638541.614539:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183641728 00000100:00100000:2.0:1788638541.614547:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183641728 00000100:00100000:2.0:1788638541.614590:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788638541.614599:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3291:x1875523183641728:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788638541.614623:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1788638541.614654:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9c754c, atime: 0x6a9c754c, ctime: 0x6a9c754c, blocks: 0xb 00010000:00010000:2.0:1788638541.614662:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b5b1260/0xa0b1f1e3b4b2ac49 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.614677:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=304s v=(0 0) 00010000:00010000:2.0:1788638541.614681:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788638541.614688:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b5b1260/0xa0b1f1e3b4b2ac49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.614706:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b5b1260/0xa0b1f1e3b4b2ac49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.614734:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b5b1260/0xa0b1f1e3b4b2ac49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.614742:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b5b1260/0xa0b1f1e3b4b2ac49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638541.614759:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788638541.615577:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3291:x1875523183641728:12345-0@lo:6:osp-syn-0-0.0 Request processed in 974us (1099us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788638541.615586:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:1.0:1788638541.615731:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c73b7da1c00/2, rc 0, transno 4294967301 00000100:00100000:1.0:1788638541.615739:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7da1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183641728:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788638541.616138:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638541.616147:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b5b1260/0xa0b1f1e3b4b2ac49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638541.616158:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638541.616163:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b5b1260/0xa0b1f1e3b4b2ac49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638541.616174:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b5b1260/0xa0b1f1e3b4b2ac49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638541.616208:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b5b1260/0xa0b1f1e3b4b2ac49 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638541.616216:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b5b1260/0xa0b1f1e3b4b2ac49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638541.616238:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638541.616240:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638541.616242:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788638541.616682:0:11986:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c7384d90a80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788638541.616688:0:11986:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7387c6a700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c7384d90180 00000020:00080000:3.0:1788638541.616691:0:11986:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7387c6a400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c73908ca000 00000020:00080000:1.0:1788638541.616770:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1788638541.616897:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:0.0:1788638541.727934:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638541.797686:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638541.797768:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174172288 00000100:00100000:0.0:1788638541.797776:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174172288 00000100:00100000:0.0:1788638541.797859:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 55 00000100:00100000:0.0:1788638541.797868:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+12:10408:x1875523174172288:12345-192.168.203.34@tcp:101:stat.0 00010000:00010000:0.0:1788638541.797891:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638541.797910:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2ac50 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434e7e expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.797999:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2ac57 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798015:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2ac57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798026:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2ac57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798040:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798051:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798058:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798298:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ac65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798308:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ac65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798327:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ac65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638541.798367:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788638541.798370:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638541.798391:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ac65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798402:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ac65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798410:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2ac57 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798416:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2ac57 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798423:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2ac57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798439:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638541.798444:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2ac57 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798453:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2ac57 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798464:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:0.0:1788638541.798467:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638541.798471:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2ac57 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798478:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2ac57 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798489:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798495:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798502:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798506:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638541.798509:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798515:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798529:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c73a1cf7900) 00010000:00010000:0.0:1788638541.798531:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638541.798534:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac5e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798540:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798583:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2ac50 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e7e expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798596:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ac65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e7e expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638541.798604:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:0.0:1788638541.798606:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788638541.798609:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01ca00, rc 0) 00000100:00100000:0.0:1788638541.798667:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+13:10408:x1875523174172288:12345-192.168.203.34@tcp:101:stat.0 Request processed in 800us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638541.798675:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 55 00000100:00100000:1.0:1788638541.964367:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638541.964750:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174172544 00000100:00100000:3.0:1788638541.964759:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174172544 00000100:00100000:3.0:1788638541.964843:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 56 00000100:00100000:3.0:1788638541.964853:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+13:10418:x1875523174172544:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:3.0:1788638541.964872:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638541.964892:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2ac6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434e85 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638541.964984:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788638541.965116:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2ac6c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e85 expref: 15 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638541.965130:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:3.0:1788638541.965133:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788638541.965138:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2ac6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e85 expref: 15 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638541.965151:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031c00, rc 0) 00000100:00100000:3.0:1788638541.965344:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+14:10418:x1875523174172544:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 482us (978us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1788638541.965352:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 56 00000100:00100000:1.0:1788638541.976423:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638541.976517:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174172800 00000100:00100000:0.0:1788638541.976528:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174172800 00000100:00100000:0.0:1788638541.976584:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 14 00000100:00100000:0.0:1788638541.976593:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+14:10418:x1875523174172800:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:0.0:1788638541.976873:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+15:10418:x1875523174172800:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 280us (468us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788638541.976881:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 14 00000100:00100000:1.0:1788638542.060153:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638542.060229:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174173056 00000100:00100000:0.0:1788638542.060240:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174173056 00000100:00100000:0.0:1788638542.060297:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 57 00000100:00100000:0.0:1788638542.060307:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+15:10424:x1875523174173056:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:0.0:1788638542.060329:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638542.060360:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2ac7a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434e8c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.060452:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac81 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.060622:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ac65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e7e expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.060634:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac81 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.060669:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ac65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e7e expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.060684:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ac65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e7e expref: 16 pid: 5843 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638542.060698:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7398c2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875523183641856:192.168.203.34@tcp:104: 00000100:00100000:0.0:1788638542.060817:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c739855a900 going to sleep for 11 seconds 00000100:00100000:1.0:1788638542.077708:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638542.077824:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174173184 00000100:00100000:2.0:1788638542.077833:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174173184 00010000:00010000:2.0:1788638542.077887:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ac65 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e7e expref: 17 pid: 5843 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638542.077928:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 40 00000100:00100000:2.0:1788638542.077938:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc076300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+17:2365:x1875523174173184:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638542.077951:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638542.077957:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ac65 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e7e expref: 17 pid: 5843 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638542.077970:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ac65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e7e expref: 17 pid: 5843 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638542.077993:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:2.0:1788638542.078010:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac81 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638542.078026:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638542.078034:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac81 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638542.078056:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638542.078109:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc076300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+17:2365:x1875523174173184:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 173us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638542.078117:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 40 00010000:00010000:0.0:1788638542.079475:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ac65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e7e expref: 16 pid: 5843 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638542.079497:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7398c2c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875523183641856:192.168.203.34@tcp:104: 00010000:00010000:0.0:1788638542.079542:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.079553:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.079559:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac81 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638542.079578:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788638542.079724:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2ac7a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e8c expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.079739:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e8c expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.079747:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:0.0:1788638542.079750:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788638542.079753:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01c600, rc 0) 00000100:00100000:0.0:1788638542.079859:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+16:10424:x1875523174173056:12345-192.168.203.34@tcp:101:bash.0 Request processed in 19552us (19714us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1788638542.079867:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 57 00000100:00100000:1.0:1788638542.085988:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638542.092951:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174173440 00000100:00100000:0.0:1788638542.092966:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174173440 00000100:00100000:0.0:1788638542.093037:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 58 00000100:00100000:0.0:1788638542.093047:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+16:10424:x1875523174173440:12345-192.168.203.34@tcp:36:bash.0 00010000:00010000:0.0:1788638542.094668:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2ac8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.094707:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2ac8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.094720:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2ac8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788638542.094806:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788638542.094836:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b541c9b5 reply state 00000000f7ec9d9d transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2ac8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638542.095553:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788638542.095714:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+19:10424:x1875523174173440:12345-192.168.203.34@tcp:36:bash.0 Request processed in 2665us (9732us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788638542.095723:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 58 00000020:00080000:0.0:1788638542.095728:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788638542.107667:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2ac8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.107684:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2ac8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.107692:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2ac8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.107699:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638542.107704:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2ac8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.107713:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2ac8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.107746:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:0.0:1788638542.107749:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638542.107754:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2ac8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.107761:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2ac8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638542.115151:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638542.115244:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174173568 00000100:00100000:2.0:1788638542.115254:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174173568 00000100:00100000:2.0:1788638542.115319:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 59 00000100:00100000:2.0:1788638542.115329:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+18:10424:x1875523174173568:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:2.0:1788638542.115363:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638542.115387:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ac96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434e93 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638542.115480:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ac9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638542.115496:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac81 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e8c expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638542.115505:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ac9d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638542.115549:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e8c expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638542.115563:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac81 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e8c expref: 19 pid: 5843 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638542.115577:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7da0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875523183641984:192.168.203.34@tcp:104: 00000100:00100000:2.0:1788638542.115658:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d903c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638542.118864:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7da0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875523183641984:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638542.118894:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ac9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638542.120932:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638542.121166:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174173696 00000100:00100000:0.0:1788638542.121176:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174173696 00010000:00010000:0.0:1788638542.121215:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac81 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e8c expref: 20 pid: 5843 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638542.121296:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 41 00000100:00100000:0.0:1788638542.121306:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+20:2365:x1875523174173696:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788638542.121321:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638542.121327:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac81 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e8c expref: 20 pid: 5843 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.121352:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac81 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e8c expref: 20 pid: 5843 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.121374:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ac81 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e8c expref: 20 pid: 5843 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.121398:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:0.0:1788638542.121403:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ac9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.121426:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ac9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.121434:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ac9d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.121471:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638542.121526:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+19:2365:x1875523174173696:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 221us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638542.121534:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 41 00010000:00010000:2.0:1788638542.121592:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ac9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638542.121601:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ac9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638542.121645:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788638542.121649:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788638542.121668:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ac9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638542.121697:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ac96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e93 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638542.121711:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ac9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e93 expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638542.121733:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:2.0:1788638542.121736:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788638542.121738:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7800, rc 0) 00000100:00100000:2.0:1788638542.121764:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+18:10424:x1875523174173568:12345-192.168.203.34@tcp:101:bash.0 Request processed in 6437us (6622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638542.121771:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 59 00000100:00100000:1.0:1788638542.135682:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638542.138675:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174173952 00000100:00100000:0.0:1788638542.138690:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174173952 00000100:00100000:0.0:1788638542.138996:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 15 00000100:00100000:0.0:1788638542.139008:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73a5716850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+18:10424:x1875523174173952:12345-192.168.203.34@tcp:35:bash.0 00000100:00100000:0.0:1788638542.139249:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73a5716850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+19:10424:x1875523174173952:12345-192.168.203.34@tcp:35:bash.0 Request processed in 242us (3575us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1788638542.139257:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 15 00000100:00100000:1.0:1788638542.256582:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638542.256657:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174174208 00000100:00100000:3.0:1788638542.256669:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174174208 00000100:00100000:3.0:1788638542.256737:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 60 00000100:00100000:3.0:1788638542.256751:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+19:10434:x1875523174174208:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:3.0:1788638542.256775:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638542.256841:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2aca4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434e9a expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638542.256946:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788638542.257072:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2aca4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e9a expref: 21 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.257086:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:3.0:1788638542.257089:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788638542.257098:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2aca4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e9a expref: 21 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.257135:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031c00, rc 0) 00000100:00100000:3.0:1788638542.257187:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+20:10434:x1875523174174208:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 442us (616us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788638542.257195:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 60 00000100:00100000:1.0:1788638542.261720:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638542.261822:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174174336 00000100:00100000:0.0:1788638542.261841:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174174336 00000100:00100000:0.0:1788638542.261913:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 61 00000100:00100000:0.0:1788638542.261924:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+20:10434:x1875523174174336:12345-192.168.203.34@tcp:34:lfs.0 00010000:00010000:0.0:1788638542.262005:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2acb2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262024:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2acb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262037:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2acb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262070:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2acb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262078:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2acb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262087:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2acb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262407:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2acc0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262417:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2acc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262425:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2acc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788638542.262468:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2acc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262481:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2acb2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262487:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2acb2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262494:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2acb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262500:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638542.262504:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2acb2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262520:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2acb2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262533:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:0.0:1788638542.262536:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638542.262541:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2acb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262547:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2acb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262561:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2acb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262567:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2acb9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262573:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2acb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262578:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638542.262581:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2acb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262587:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2acb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262594:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c73a1cf7900) 00010000:00010000:0.0:1788638542.262596:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638542.262599:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2acb9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262614:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2acb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262629:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2acc0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262635:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2acc0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262640:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2acc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262645:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01ca00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638542.262647:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2acc0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262653:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2acc0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262660:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:0.0:1788638542.262663:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638542.262666:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2acc0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.262671:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2acc0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638542.262750:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+20:10434:x1875523174174336:12345-192.168.203.34@tcp:34:lfs.0 Request processed in 826us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638542.262758:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 61 00000100:00100000:1.0:1788638542.273240:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638542.273458:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174174592 00000100:00100000:3.0:1788638542.273468:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174174592 00000100:00100000:3.0:1788638542.273521:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 16 00000100:00100000:3.0:1788638542.273530:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+20:10434:x1875523174174592:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:3.0:1788638542.273745:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+21:10434:x1875523174174592:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 215us (514us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788638542.273752:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 16 00000100:00100000:1.0:1788638542.338420:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638542.338513:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174174848 00000100:00100000:3.0:1788638542.338524:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174174848 00000100:00100000:3.0:1788638542.338640:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 62 00000100:00100000:3.0:1788638542.338652:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+21:10437:x1875523174174848:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:3.0:1788638542.338676:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638542.338697:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2acc7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434ea1 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.338778:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2acce lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339007:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2acce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339021:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2acce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339049:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2acd5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339057:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2acd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339065:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2acd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339398:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2acdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339409:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2acdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339416:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2acdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638542.339427:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788638542.339515:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2acce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339523:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2acce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339530:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2acce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339535:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638542.339540:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2acce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339559:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2acce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339572:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:3.0:1788638542.339575:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638542.339580:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2acce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339586:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2acce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339599:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2acd5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339605:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2acd5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339610:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2acd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339616:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638542.339618:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2acd5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339624:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2acd5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339631:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c7393e81100) 00010000:00010000:3.0:1788638542.339633:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638542.339636:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2acd5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339652:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2acd5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339700:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2acc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ea1 expref: 24 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339714:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2acdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ea1 expref: 23 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.339721:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:3.0:1788638542.339723:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788638542.339726:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031a00, rc 0) 00000100:00100000:3.0:1788638542.340466:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+23:10437:x1875523174174848:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 1811us (2052us total) trans 4294967347 rc 0/0 00000100:00100000:3.0:1788638542.340476:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 62 00000100:00100000:1.0:1788638542.345163:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638542.345206:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638542.345293:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174174976 00000100:00100000:0.0:1788638542.345312:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174174976 00000100:00100000:0.0:1788638542.345375:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 63 00000100:00100000:0.0:1788638542.345385:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+23:10437:x1875523174174976:12345-192.168.203.34@tcp:54:lfs.0 00010000:00010000:0.0:1788638542.345461:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2acea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.345478:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2acea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.345490:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2acea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.345515:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2acea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.345522:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2acea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.345529:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2acea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.345535:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01ca00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638542.345539:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2acea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.345546:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2acea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.345557:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:0.0:1788638542.345560:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788638542.345565:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2acea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.345579:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2acea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638542.345644:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+23:10437:x1875523174174976:12345-192.168.203.34@tcp:54:lfs.0 Request processed in 260us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638542.345650:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 63 00000100:00100000:3.0:1788638542.348710:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174175104 00000100:00100000:3.0:1788638542.348736:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174175104 00000100:00100000:2.0:1788638542.349159:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 4 00000100:00100000:2.0:1788638542.349170:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+23:2364:x1875523174175104:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638542.349185:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638542.349210:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2acdc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ea1 expref: 23 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638542.349228:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:2.0:1788638542.349233:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638542.349304:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+22:2364:x1875523174175104:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 136us (4097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638542.349310:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 4 00000100:00100000:1.0:1788638542.350289:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638542.350514:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174175360 00000100:00100000:3.0:1788638542.350521:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174175360 00000100:00100000:3.0:1788638542.350567:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 17 00000100:00100000:3.0:1788638542.350574:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+22:10437:x1875523174175360:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:3.0:1788638542.351009:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+23:10437:x1875523174175360:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 209us (499us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788638542.351018:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 17 00000100:00100000:1.0:1788638542.537690:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638542.537804:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174175616 00000100:00100000:0.0:1788638542.537815:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174175616 00000100:00100000:0.0:1788638542.537882:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 64 00000100:00100000:0.0:1788638542.537891:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+23:10455:x1875523174175616:12345-192.168.203.34@tcp:101:cat.0 00010000:00010000:0.0:1788638542.537921:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638542.537940:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2acf1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434ea8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.538026:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2acf8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.538040:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2acf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.538051:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2acf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638542.538061:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788638542.538186:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2acf1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ea8 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.538203:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2acf8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ea8 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.538224:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:0.0:1788638542.538227:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788638542.538230:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01c600, rc 0) 00000100:00100000:0.0:1788638542.538286:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+25:10455:x1875523174175616:12345-192.168.203.34@tcp:101:cat.0 Request processed in 396us (605us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788638542.538301:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 64 00000100:00100000:1.0:1788638542.565013:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638542.565834:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174175744 00000100:00100000:0.0:1788638542.565845:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174175744 00000100:00100000:0.0:1788638542.565916:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 65 00000100:00100000:0.0:1788638542.565927:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+25:10456:x1875523174175744:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638542.565951:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638542.565972:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ad06 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434eaf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.566034:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2ad0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.566048:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2ad0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.566059:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2ad0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638542.566092:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788638542.566096:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638542.566112:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2ad0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.566155:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ad06 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434eaf expref: 27 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.566174:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2ad0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434eaf expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.566181:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:0.0:1788638542.566184:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788638542.566188:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01d800, rc 0) 00000100:00100000:0.0:1788638542.566253:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+26:10456:x1875523174175744:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 328us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638542.566260:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 65 00000100:00100000:1.0:1788638542.572281:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638542.572650:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174176128 00000100:00100000:0.0:1788638542.572660:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174176128 00000100:00100000:0.0:1788638542.572718:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 18 00000100:00100000:0.0:1788638542.572727:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+26:10456:x1875523174176128:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:0.0:1788638542.573227:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+27:10456:x1875523174176128:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 499us (952us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788638542.573235:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 18 00000100:00100000:1.0:1788638542.575490:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638542.575575:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174176256 00000100:00100000:3.0:1788638542.575583:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174176256 00000100:00100000:3.0:1788638542.575662:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 5 00000100:00100000:3.0:1788638542.575672:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+27:10456:x1875523174176256:12345-192.168.203.34@tcp:103:lfs.0 00010000:00010000:3.0:1788638542.575687:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788638542.575711:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ac9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e93 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.575733:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2acf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ea8 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.575746:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2aba1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e54 expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.575755:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c738a6e9500) 00010000:00010000:3.0:1788638542.575765:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638542.575885:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+24:10456:x1875523174176256:12345-192.168.203.34@tcp:103:lfs.0 Request processed in 214us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638542.575892:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 5 00000100:00100000:2.0:1788638542.578209:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638542.578282:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174176384 00000100:00100000:3.0:1788638542.578298:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174176384 00000100:00100000:3.0:1788638542.578353:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 66 00000100:00100000:3.0:1788638542.578361:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+24:10456:x1875523174176384:12345-192.168.203.34@tcp:58:lfs.0 00010000:00010000:3.0:1788638542.578476:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2ad14 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.578492:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2ad14 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.578503:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2ad14 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788638542.579593:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788638542.579780:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788638542.580010:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788638542.580119:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+24:10456:x1875523174176384:12345-192.168.203.34@tcp:58:lfs.0 Request processed in 1755us (1914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638542.580128:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 66 00000100:00100000:3.0:1788638542.600719:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638542.602018:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174176512 00000100:00100000:0.0:1788638542.602029:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174176512 00000100:00100000:0.0:1788638542.602144:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 67 00000100:00100000:0.0:1788638542.602156:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+24:10458:x1875523174176512:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638542.602177:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638542.602199:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ad1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434eb6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602286:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2ad22 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602309:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2ad22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602321:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2ad22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602346:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2ad29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602353:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2ad29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602360:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2ad29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602592:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2ad30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602602:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2ad30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602610:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2ad30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638542.602644:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788638542.602649:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638542.602666:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2ad30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602688:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2ad30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602696:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2ad22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602703:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2ad22 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602710:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2ad22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602716:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01ce00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638542.602720:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2ad22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602727:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2ad22 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602738:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:0.0:1788638542.602741:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638542.602746:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2ad22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602752:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2ad22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602764:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2ad29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602769:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2ad29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602822:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2ad29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602835:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638542.602838:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2ad29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602844:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2ad29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602852:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c73a1cf7900) 00010000:00010000:0.0:1788638542.602854:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638542.602857:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2ad29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602862:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2ad29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602892:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2ad1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434eb6 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602903:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2ad30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434eb6 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.602910:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81100) 00010000:00010000:0.0:1788638542.602912:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788638542.602915:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01d000, rc 0) 00000100:00100000:0.0:1788638542.602982:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+25:10458:x1875523174176512:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 828us (2273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638542.602997:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 67 00010000:00010000:0.0:1788638542.752939:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788638542.882610:0:11706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788638542.882620:0:11706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788638542.882670:0:11706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788638542.882677:0:11706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788638542.882831:0:11706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7da1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11706:1875523183642112:192.168.203.34@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788638542.882934:0:11706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d90d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788638542.906697:0:11706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7da1880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11706:1875523183642112:192.168.203.34@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788638542.913834:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638542.915145:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174176640 00000100:00100000:1.0:1788638542.915158:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174176640 00000100:00100000:1.0:1788638542.915223:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 1 00000100:00100000:1.0:1788638542.915233:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:00196f64-ae55-4ffc-b84c-468028ab3a77+25:10469:x1875523174176640:12345-192.168.203.34@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788638542.915340:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:00196f64-ae55-4ffc-b84c-468028ab3a77+25:10469:x1875523174176640:12345-192.168.203.34@tcp:900:lhsmtool_posix.0 Request processed in 109us (1515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638542.915348:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 1 00000100:00100000:3.0:1788638542.919742:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638542.919863:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174176768 00000100:00100000:1.0:1788638542.919872:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174176768 00000100:00100000:1.0:1788638542.919941:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 68 00000100:00100000:1.0:1788638542.919952:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+25:10469:x1875523174176768:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788638542.919985:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788638542.920114:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+25:10469:x1875523174176768:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 Request processed in 155us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638542.920123:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 68 00000100:00100000:2.0:1788638542.930506:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638542.930692:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174176896 00000100:00100000:3.0:1788638542.930702:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174176896 00000100:00100000:3.0:1788638542.930817:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 69 00000100:00100000:3.0:1788638542.930828:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+25:10469:x1875523174176896:12345-192.168.203.34@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788638542.930898:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ad37 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.930916:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ad37 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.930929:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ad37 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.930975:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ad3e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.930983:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ad3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.930990:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ad3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931033:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ad45 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931041:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ad45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931047:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ad45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638542.931083:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788638542.931099:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788638542.931114:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ad45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931125:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ad37 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931132:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ad37 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931139:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ad37 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931145:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638542.931149:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ad37 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931157:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ad37 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931168:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c73a1cf7600) 00010000:00010000:3.0:1788638542.931177:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638542.931183:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ad37 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931199:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ad37 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931215:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ad3e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931221:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ad3e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931227:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ad3e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931232:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638542.931235:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ad3e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931240:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ad3e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931248:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9c7393e81b00) 00010000:00010000:3.0:1788638542.931250:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638542.931252:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ad3e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931257:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ad3e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931270:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ad45 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931281:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ad45 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931295:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ad45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931301:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638542.931769:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ad45 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931778:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ad45 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931805:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81100) 00010000:00010000:3.0:1788638542.931807:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638542.931811:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ad45 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.931817:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ad45 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638542.931902:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+25:10469:x1875523174176896:12345-192.168.203.34@tcp:34:lhsmtool_posix.0 Request processed in 1074us (1404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638542.931910:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 69 00000100:00100000:3.0:1788638542.948000:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638542.948118:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174177152 00000100:00100000:0.0:1788638542.948127:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174177152 00000100:00100000:0.0:1788638542.948188:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 70 00000100:00100000:0.0:1788638542.948199:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+25:10469:x1875523174177152:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788638542.948220:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638542.948241:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2ad4c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434ebd expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.948347:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2ad53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.948363:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2ad53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.948375:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2ad53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638542.948387:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788638542.948480:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2ad53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.948488:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2ad53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.948495:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2ad53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.948501:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01cc00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638542.948512:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2ad53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.948521:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2ad53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.948535:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81100) 00010000:00010000:0.0:1788638542.948538:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788638542.948542:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2ad53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.948548:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2ad53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.948589:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2ad4c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ebd expref: 27 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.948599:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c73a1cf7600) 00010000:00010000:0.0:1788638542.948602:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788638542.948605:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2ad4c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ebd expref: 27 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638542.948614:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01ce00, rc 0) 00000100:00100000:0.0:1788638542.948688:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+26:10469:x1875523174177152:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 491us (696us total) trans 4294967351 rc 301/301 00000100:00100000:0.0:1788638542.948696:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 70 00000100:00100000:0.0:1788638542.958900:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638542.959068:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174177280 00000100:00100000:1.0:1788638542.959079:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174177280 00000100:00100000:1.0:1788638542.959155:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 71 00000100:00100000:1.0:1788638542.959165:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+26:10469:x1875523174177280:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788638542.959199:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788638542.959307:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+26:10469:x1875523174177280:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 Request processed in 142us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638542.959321:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 71 00000100:00100000:0.0:1788638542.964416:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638542.964582:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174177536 00000100:00100000:1.0:1788638542.964592:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174177536 00000100:00100000:1.0:1788638542.964723:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 72 00000100:00100000:1.0:1788638542.964736:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+26:10469:x1875523174177536:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788638542.964761:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638542.964764:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788638542.965173:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2ad0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434eaf expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638542.965193:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:1.0:1788638542.965198:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788638542.965213:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2ad61 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434ec4 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788638542.967884:0:7634:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788638542.969845:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2ad68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638542.969867:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2ad68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638542.969878:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2ad68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638542.969959:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2ad61 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ec4 expref: 28 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638542.969993:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2ad68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ec4 expref: 27 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638542.970000:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c7398420f00) 00010000:00010000:1.0:1788638542.970003:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788638542.970006:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385308000, rc 0) 00000100:00100000:1.0:1788638542.970150:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+27:10469:x1875523174177536:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 5407us (5734us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788638542.970166:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 72 00000100:00100000:0.0:1788638542.984232:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638542.984761:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174177792 00000100:00100000:3.0:1788638542.984772:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174177792 00000100:00100000:3.0:1788638542.984853:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 73 00000100:00100000:3.0:1788638542.984863:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+27:10469:x1875523174177792:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788638542.984936:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638542.984965:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2ad68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ec4 expref: 27 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.984981:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c7398420f00) 00010000:00010000:3.0:1788638542.984992:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788638542.985016:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ad76 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.985028:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ad76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.985037:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ad76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.985097:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ad7d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x5c1dc21a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.985105:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ad7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5c1dc21a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.985112:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ad7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5c1dc21a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.985297:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ad76 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.985306:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ad76 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.985313:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ad76 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.985337:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638542.985342:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ad76 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.985350:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ad76 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.985360:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:3.0:1788638542.985363:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638542.985366:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ad76 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.985373:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ad76 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.985384:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ad7d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5c1dc21a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.985390:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ad7d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5c1dc21a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.985395:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ad7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5c1dc21a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.985400:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638542.985403:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ad7d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5c1dc21a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.985409:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ad7d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5c1dc21a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.985428:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x5c1dc21a (ffff9c7393e81b00) 00010000:00010000:3.0:1788638542.985431:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638542.985434:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ad7d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5c1dc21a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638542.985441:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ad7d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5c1dc21a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638542.985524:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+26:10469:x1875523174177792:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 Request processed in 660us (1300us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788638542.985531:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 73 00000100:00100000:3.0:1788638542.998078:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638542.998151:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174177920 00000100:00100000:1.0:1788638542.998160:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174177920 00000100:00100000:1.0:1788638542.998216:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 74 00000100:00100000:1.0:1788638542.998227:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+26:10469:x1875523174177920:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788638542.998247:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638542.998271:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2ad84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434ecb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638542.998308:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2ad8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638542.998322:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2ad8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638542.998343:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2ad8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638542.998446:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2ad84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ecb expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638542.998474:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2ad8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ecb expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638542.998483:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:1.0:1788638542.998485:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788638542.998489:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309600, rc 0) 00000100:00100000:1.0:1788638542.998548:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+27:10469:x1875523174177920:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 323us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638542.998555:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 74 00000100:00100000:3.0:1788638543.007099:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638543.007196:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174178176 00000100:00100000:2.0:1788638543.007207:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174178176 00000100:00100000:2.0:1788638543.007278:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 75 00000100:00100000:2.0:1788638543.007288:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+27:10469:x1875523174178176:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788638543.007377:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2ad92 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.007393:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2ad92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.007406:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2ad92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788638543.009602:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1788638543.010107:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 306081323521ns, next at 307080832549ns, rc = 0 00000004:00010000:2.0:1788638543.010227:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007cfa39b7 reply state 00000000cf57fb8e transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2ad92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638543.010239:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788638543.010371:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+29:10469:x1875523174178176:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 Request processed in 3079us (3276us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1788638543.010381:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 75 00000100:00080000:3.0:1788638543.010811:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788638543.013889:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2ad92 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.013907:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2ad92 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.013916:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2ad92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.013922:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638543.013927:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2ad92 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.013936:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2ad92 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.013953:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:1.0:1788638543.013956:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788638543.013961:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2ad92 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.013982:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2ad92 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638543.020227:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638543.020413:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174178304 00000100:00100000:1.0:1788638543.020423:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174178304 00000100:00100000:1.0:1788638543.020526:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 76 00000100:00100000:1.0:1788638543.020536:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+28:10469:x1875523174178304:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788638543.020559:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638543.020590:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2ad99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434ed2 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.020663:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2ad99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ed2 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.020678:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2ad99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ed2 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.020695:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:1.0:1788638543.020698:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788638543.020702:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385308c00, rc 0) 00000100:00100000:1.0:1788638543.020758:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+29:10469:x1875523174178304:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 224us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638543.020764:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 76 00000100:00100000:3.0:1788638543.030097:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638543.030344:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174178432 00000100:00100000:1.0:1788638543.030354:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174178432 00000100:00100000:1.0:1788638543.030403:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 25 00000100:00100000:1.0:1788638543.030411:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2363:x1875523174178432:12345-192.168.203.34@tcp:8:lhsmtool_posix.0 00010000:00080000:1.0:1788638543.030473:0:6684:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:1.0:1788638543.030505:0:6684:0:(genops.c:1385:class_connect()) connect: client 00196f64-ae55-4ffc-b84c-468028ab3a77, cookie 0xa0b1f1e3b4b2ada0 00002000:00100000:1.0:1788638543.030516:0:6684:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 00196f64-ae55-4ffc-b84c-468028ab3a77/ffff9c73ad6ef800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788638543.030538:0:6684:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type 37, return 37 00002000:00080000:1.0:1788638543.030767:0:6684:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788638543.030833:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9c73ad6e9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788638543.030897:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2363:x1875523174178432:12345-192.168.203.34@tcp:8:lhsmtool_posix.0 Request processed in 485us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638543.030904:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 25 00000100:00100000:2.0:1788638543.032990:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638543.033089:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174178560 00000100:00100000:0.0:1788638543.033109:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174178560 00000100:00100000:0.0:1788638543.033175:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 26 00000100:00100000:0.0:1788638543.033185:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+6:0:x1875523174178560:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788638543.033778:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788638543.072896:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788638543.072926:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7391b4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183642240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788638543.072990:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638543.073051:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183642240 00000100:00100000:3.0:1788638543.073058:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183642240 00000100:00100000:3.0:1788638543.073109:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788638543.073118:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1875523183642240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788638543.073150:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788638543.073194:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1875523183642240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638543.073215:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788638543.073234:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788638543.073271:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7391b4aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183642240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788638543.112171:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638543.115506:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788638543.115522:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788638543.115970:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638543.116003:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638543.117584:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174178944 00000100:00100000:1.0:1788638543.117598:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174178944 00000100:00100000:3.0:1788638543.118438:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174178816 00000100:00100000:3.0:1788638543.118445:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174178816 00000100:00100000:1.0:1788638543.118554:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 140 00000100:00100000:1.0:1788638543.118565:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2365:x1875523174178944:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638543.118649:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b49c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2365:x1875523174178944:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 86us (2645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638543.118655:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 140 00000100:00100000:2.0:1788638543.120729:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174178688 00000100:00100000:2.0:1788638543.120743:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174178688 00000100:00100000:2.0:1788638543.120806:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 290 00000100:00100000:2.0:1788638543.120829:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+13:2365:x1875523174178688:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638543.120897:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383685450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+13:2365:x1875523174178688:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 67us (4929us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638543.120904:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 290 00000100:00100000:3.0:1788638543.121234:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788638543.121248:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 77 00000100:00100000:3.0:1788638543.121256:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2364:x1875523174178816:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638543.121296:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2364:x1875523174178816:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 40us (9136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638543.121303:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 77 00000100:00080000:1.0:1788638543.123037:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788638543.123047:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1788638543.129942:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:3.0:1788638543.129959:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 00196f64-ae55-4ffc-b84c-468028ab3a77 00000100:00100000:0.0:1788638543.130308:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+5:0:x1875523174178560:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 Request processed in 97119us (97321us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788638543.130320:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 26 00000100:00100000:3.0:1788638543.137731:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638543.138185:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174179200 00000100:00100000:1.0:1788638543.138195:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174179200 00000100:00100000:1.0:1788638543.138248:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 19 00000100:00100000:1.0:1788638543.138258:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+29:10469:x1875523174179200:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788638543.138489:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b49f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+30:10469:x1875523174179200:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 Request processed in 231us (767us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1788638543.138496:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 19 00000100:00100000:0.0:1788638543.144336:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638543.144465:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174179456 00000100:00100000:2.0:1788638543.144474:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174179456 00000100:00100000:2.0:1788638543.144565:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 77 00000100:00100000:2.0:1788638543.144576:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+30:10469:x1875523174179456:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788638543.144693:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+30:10469:x1875523174179456:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 Request processed in 118us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638543.144701:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 77 00000100:00100000:2.0:1788638543.158450:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638543.162750:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174179584 00000100:00100000:0.0:1788638543.162765:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174179584 00000100:00100000:0.0:1788638543.164419:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 78 00000100:00100000:0.0:1788638543.164436:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+30:10469:x1875523174179584:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788638543.164457:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638543.164478:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2ada7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434ed9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.164561:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2adae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.164576:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2adae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.164587:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2adae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638543.164622:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638543.164643:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2adae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.164668:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2ada7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ed9 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.164692:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2adae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ed9 expref: 31 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.164702:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:0.0:1788638543.164705:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788638543.164708:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01d200, rc 0) 00000100:00100000:0.0:1788638543.164775:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+31:10469:x1875523174179584:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 344us (6334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638543.164797:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 78 00000100:00100000:0.0:1788638543.172872:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638543.174163:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174179712 00000100:00100000:1.0:1788638543.174175:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174179712 00000100:00100000:1.0:1788638543.174238:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 27 00000100:00100000:1.0:1788638543.174247:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2364:x1875523174179712:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788638543.174265:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638543.174287:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2adb5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434ee0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788638543.174313:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c754f, blocks: 0x1 00010000:00010000:1.0:1788638543.174341:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=306s v=(0 0) 00010000:00010000:1.0:1788638543.174346:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638543.174355:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2adb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ee0 expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.174375:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2adb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ee0 expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.174388:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309400, rc 0) 00000100:00100000:1.0:1788638543.174446:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174179712:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 200us (1583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638543.174453:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 27 00000100:00100000:0.0:1788638543.183975:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638543.185863:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174179968 00000100:00100000:1.0:1788638543.185875:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174179968 00000100:00100000:1.0:1788638543.185929:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 79 00000100:00100000:1.0:1788638543.185939:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+31:10469:x1875523174179968:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788638543.186042:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+31:10469:x1875523174179968:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 Request processed in 104us (2075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638543.186061:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 79 00000100:00100000:1.0:1788638543.193092:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638543.193130:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174180096 00000100:00100000:1.0:1788638543.193140:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174180096 00000100:00100000:1.0:1788638543.193192:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 28 00000100:00100000:1.0:1788638543.193201:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:10469:x1875523174180096:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788638543.193219:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638543.193240:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2adbc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434ee7 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.193273:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2adb5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ee0 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.193283:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638543.193300:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638543.193307:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2adbc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ee7 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.193350:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2adb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ee0 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.193366:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2adb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ee0 expref: 7 pid: 6687 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638543.193380:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6684:1875523183642368:192.168.203.34@tcp:104: 00000100:00100000:1.0:1788638543.193474:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387969d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788638543.196073:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6684:1875523183642368:192.168.203.34@tcp:104: 00010000:00010000:1.0:1788638543.196107:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2adbc lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ee7 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.196127:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309e00, rc 0) 00000100:00100000:1.0:1788638543.196170:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+7:10469:x1875523174180096:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 2970us (3090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638543.196179:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 28 00000100:00100000:1.0:1788638543.203823:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638543.203864:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174180224 00000100:00100000:1.0:1788638543.203874:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174180224 00010000:00010000:1.0:1788638543.204712:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2adb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ee0 expref: 7 pid: 6687 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638543.204759:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 42 00000100:00100000:1.0:1788638543.204770:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dfb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2365:x1875523174180224:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638543.204804:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638543.204827:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2adb5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ee0 expref: 7 pid: 6687 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.204841:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2adb5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ee0 expref: 7 pid: 6687 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.204863:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2adb5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ee0 expref: 7 pid: 6687 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.204891:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638543.204896:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638543.205078:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2adbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ee7 expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.205090:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2adbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ee7 expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.205134:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2adbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ee7 expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638543.205148:0:5828:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1875523183642496:192.168.203.34@tcp:105: 00000100:00100000:1.0:1788638543.205242:0:5828:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387969d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788638543.210750:0:5828:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c2d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5828:1875523183642496:192.168.203.34@tcp:105: 00010000:00010000:2.0:1788638543.210775:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638543.210870:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dfb450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2365:x1875523174180224:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 6102us (7054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638543.210880:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 42 00000100:00100000:1.0:1788638543.218065:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638543.218199:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174180352 00000100:00100000:2.0:1788638543.218208:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174180352 00002000:00100000:2.0:1788638543.218253:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9c73ad6c1500 x1875523174180352/t0(0) o4->00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp:519/0 lens 504/0 e 0 to 0 dl 1788638554 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788638543.218265:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c73ad6c1500 with x1875523174180352 ext(0->8) 00002000:00010000:2.0:1788638543.218270:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c73ad6c1500 00000100:00100000:2.0:1788638543.218356:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 0 00000100:00100000:2.0:1788638543.218366:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2365:x1875523174180352:12345-192.168.203.34@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788638543.220401:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2365:x1875523174180352:12345-192.168.203.34@tcp:4:lhsmtool_posix.0 Request processed in 2029us (2338us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788638543.220414:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 0 00002000:00100000:2.0:1788638543.220424:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9c73ad6c1500 x1875523174180352/t4294967302(0) o4->00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp:519/0 lens 504/448 e 0 to 0 dl 1788638554 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788638543.220434:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c73ad6c1500 with x1875523174180352 ext(0->8) 00002000:00010000:2.0:1788638543.220440:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c73ad6c1500 00000100:00100000:3.0:1788638543.235762:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638543.235829:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174180480 00000100:00100000:2.0:1788638543.235839:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174180480 00000100:00100000:2.0:1788638543.235910:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 80 00000100:00100000:2.0:1788638543.235921:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+31:10469:x1875523174180480:12345-192.168.203.34@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788638543.352262:0:11987:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:3.0:1788638543.352406:0:11986:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:3.0:1788638543.352419:0:11986:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:3.0:1788638543.352433:0:11986:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:0.0:1788638543.352476:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+25:10469:x1875523174180480:12345-192.168.203.34@tcp:44:lhsmtool_posix.0 Request processed in 116551us (116718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638543.352488:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 80 00000100:00100000:1.0:1788638543.355244:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000020:00080000:3.0:1788638543.355385:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1788638543.355398:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788638543.355550:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7391b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183642624:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788638543.355745:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174180608 00000100:00100000:2.0:1788638543.355752:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174180608 00000100:00100000:3.0:1788638543.356258:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638543.357869:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183642624 00000100:00100000:2.0:1788638543.357882:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183642624 00000100:00100000:1.0:1788638543.358127:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 29 00000100:00100000:1.0:1788638543.358142:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2364:x1875523174180608:12345-192.168.203.34@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1788638543.358306:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788638543.358315:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183642624:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788638543.358489:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788638543.358493:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788638543 00002000:00010000:2.0:1788638543.358495:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788638543.358497:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788638543 -> 1788638543 00002000:00010000:2.0:1788638543.358500:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788638543.358556:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3294:x1875523183642624:12345-0@lo:2:osp-syn-1-0.0 Request processed in 242us (2303us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788638543.358564:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000004:00080000:3.0:1788638543.358718:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c7391b4bb80/2, rc 0, transno 4294967303 00000100:00100000:3.0:1788638543.358726:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7391b4bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183642624:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1788638543.358997:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788638543.438678:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1788638543.438695:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1788638543.439075:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174180608:12345-192.168.203.34@tcp:16:lhsmtool_posix.0 Request processed in 80931us (83832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638543.439087:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 29 00000100:00100000:1.0:1788638543.441950:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638543.442200:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174180864 00000100:00100000:2.0:1788638543.442211:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174180864 00000100:00100000:2.0:1788638543.442267:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 81 00000100:00100000:2.0:1788638543.442278:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+13:10469:x1875523174180864:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788638543.442352:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638543.442387:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2adae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ed9 expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.442409:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:2.0:1788638543.442416:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788638543.442526:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2adc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.442543:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2adc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.442555:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2adc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788638543.443996:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000620ce84e reply state 0000000080fadfad transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2adc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638543.444013:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788638543.445563:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+14:10469:x1875523174180864:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 Request processed in 3279us (3613us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1788638543.445574:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 81 00010000:00010000:0.0:1788638543.448830:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2adc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.448854:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2adc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.448864:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2adc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.448871:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638543.448877:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2adc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.448905:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2adc3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.448927:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:0.0:1788638543.448931:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638543.448938:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2adc3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.448946:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2adc3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638543.452482:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638543.452661:0:11999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174180992 00000100:00100000:0.0:1788638543.452680:0:11999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174180992 00000100:00100000:0.0:1788638543.452809:0:11999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 31 00000100:00100000:0.0:1788638543.452827:0:11999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2365:x1875523174180992:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788638543.453203:0:11999:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788638543.453208:0:11999:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788638543 -> 1788638542 00002000:00010000:0.0:1788638543.453211:0:11999:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788638540 00002000:00010000:0.0:1788638543.453213:0:11999:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788638543 -> 1788638542 00002000:00010000:0.0:1788638543.453216:0:11999:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788638543.453371:0:11999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2365:x1875523174180992:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 Request processed in 549us (896us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788638543.453382:0:11999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 31 00000100:00100000:0.0:1788638543.458612:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638543.458849:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174181248 00000100:00100000:1.0:1788638543.458870:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174181248 00000100:00100000:0.0:1788638543.459003:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 82 00000100:00100000:0.0:1788638543.459016:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+13:10469:x1875523174181248:12345-192.168.203.34@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788638543.459091:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2adca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.459117:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2ad8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ecb expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.459127:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2adca lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.459164:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2ad8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ecb expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.459179:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2ad8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ecb expref: 13 pid: 5844 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638543.459194:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7398c2ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875523183642752:192.168.203.34@tcp:104: 00000100:00100000:0.0:1788638543.459286:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738563d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638543.469748:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638543.469825:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7398c2ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875523183642752:192.168.203.34@tcp:104: 00010000:00010000:0.0:1788638543.469854:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2adca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638543.471453:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174181376 00000100:00100000:1.0:1788638543.471483:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174181376 00010000:00010000:1.0:1788638543.471556:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2ad8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ecb expref: 14 pid: 5844 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638543.471623:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 43 00000100:00100000:1.0:1788638543.471644:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+14:2365:x1875523174181376:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638543.471666:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638543.471676:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2ad8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ecb expref: 14 pid: 5844 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.471696:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2ad8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ecb expref: 14 pid: 5844 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.471731:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2ad8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ecb expref: 14 pid: 5844 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.471753:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:1.0:1788638543.471759:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2adca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.471771:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2adca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.471805:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2adca lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.471842:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638543.471938:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c28e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+13:2365:x1875523174181376:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 304us (2199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638543.471947:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 43 00010000:00010000:0.0:1788638543.473591:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2adca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.473609:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2adca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.473641:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2adca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.473665:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2adca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.473672:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2adca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.473678:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638543.473682:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2adca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.473690:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2adca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.473706:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:0.0:1788638543.473709:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788638543.473714:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2adca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.473720:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2adca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638543.473829:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+12:10469:x1875523174181248:12345-192.168.203.34@tcp:55:lhsmtool_posix.0 Request processed in 14812us (15222us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788638543.473839:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 82 00000100:00100000:0.0:1788638543.481031:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638543.481631:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174181504 00000100:00100000:1.0:1788638543.481651:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174181504 00000100:00100000:1.0:1788638543.481753:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 32 00000100:00100000:1.0:1788638543.481768:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bba5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2364:x1875523174181504:12345-192.168.203.34@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788638543.481855:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2add1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.481882:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2adbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ee7 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.481892:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638543.481897:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788638543.481902:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2add1 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.481950:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2adbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ee7 expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.481968:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2adbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ee7 expref: 7 pid: 6684 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638543.481988:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1875523183642880:192.168.203.34@tcp:104: 00000100:00100000:1.0:1788638543.482108:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387969d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788638543.495355:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1875523183642880:192.168.203.34@tcp:104: 00010000:00010000:3.0:1788638543.495386:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2add1 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638543.503146:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638543.503227:0:11689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174181632 00000100:00100000:2.0:1788638543.503238:0:11689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174181632 00010000:00010000:2.0:1788638543.503286:0:11689:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2adbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ee7 expref: 8 pid: 6684 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638543.503356:0:11689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 44 00000100:00100000:2.0:1788638543.503366:0:11689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2365:x1875523174181632:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638543.503381:0:11689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638543.503403:0:11689:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2adbc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ee7 expref: 8 pid: 6684 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.503416:0:11689:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2adbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ee7 expref: 8 pid: 6684 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.503439:0:11689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2adbc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ee7 expref: 8 pid: 6684 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.503466:0:11689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788638543.503470:0:11689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788638543.503477:0:11689:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2add1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.503487:0:11689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2add1 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.503520:0:11689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638543.503568:0:11689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2365:x1875523174181632:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 203us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638543.503575:0:11689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 44 00010000:00010000:0.0:1788638543.503819:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2add1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.503840:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2add1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.503866:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2add1 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.503874:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2add1 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.503881:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2add1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.503887:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309c00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638543.503892:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2add1 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.503900:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2add1 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.503912:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2add1 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.503918:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2add1 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638543.503988:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bba5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174181504:12345-192.168.203.34@tcp:1:lhsmtool_posix.0 Request processed in 22223us (22966us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638543.503997:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 32 00000100:00100000:0.0:1788638543.520027:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638543.522151:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174181888 00000100:00100000:1.0:1788638543.522170:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174181888 00000100:00100000:1.0:1788638543.522262:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 83 00000100:00100000:1.0:1788638543.522277:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+12:10469:x1875523174181888:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788638543.522405:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2add8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.522433:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2add8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.522450:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2add8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.522763:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2addf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.522836:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2ad99 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ed2 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.522847:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2addf lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.522898:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2ad99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ed2 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.522919:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2ad99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ed2 expref: 13 pid: 5844 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638543.522941:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875523183643008:192.168.203.34@tcp:104: 00000100:00100000:0.0:1788638543.523136:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387969b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788638543.531730:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638543.532022:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875523183643008:192.168.203.34@tcp:104: 00010000:00010000:3.0:1788638543.532049:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2addf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638543.532157:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174182016 00000100:00100000:1.0:1788638543.532177:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174182016 00010000:00010000:1.0:1788638543.532213:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2ad99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ed2 expref: 14 pid: 5844 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638543.532254:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 45 00000100:00100000:1.0:1788638543.532263:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+14:2365:x1875523174182016:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638543.532277:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638543.532292:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2ad99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ed2 expref: 14 pid: 5844 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.532305:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2ad99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ed2 expref: 14 pid: 5844 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.532335:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2ad99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ed2 expref: 14 pid: 5844 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.532350:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:1.0:1788638543.532354:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2addf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.532362:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2addf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.532369:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2addf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.532393:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638543.532441:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+13:2365:x1875523174182016:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 180us (722us total) trans 0 rc 0/0 00010000:00010000:3.0:1788638543.532563:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2addf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.532571:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2addf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788638543.532741:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1788638543.532894:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1788638543.532936:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1788638543.533007:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1875523183643136:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788638543.533070:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638543.533096:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7385610180 going to sleep for 11 seconds 00000100:00100000:3.0:1788638543.533117:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183643136 00000100:00100000:3.0:1788638543.533121:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183643136 00000100:00100000:3.0:1788638543.533149:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638543.533161:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1875523183643136:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788638543.533220:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1875523183643136:12345-0@lo:1000:mdt00_002.0 Request processed in 60us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638543.533227:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638543.533259:0:5844:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788638543.533264:0:5844:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c7391b4bb80, transno 4294967303 00000100:00100000:3.0:1788638543.533275:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1875523183643136:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788638543.533710:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1788638543.533757:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1875523183643264:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788638543.533809:0:5844:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638543.533826:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73856103c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638543.534009:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183643264 00000100:00100000:3.0:1788638543.534014:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183643264 00000100:00100000:3.0:1788638543.534041:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788638543.534047:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5844:x1875523183643264:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788638543.534203:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5844:x1875523183643264:12345-0@lo:1000:mdt00_002.0 Request processed in 155us (392us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788638543.534210:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788638543.534243:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1875523183643264:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788638543.534274:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2addf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.534283:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2addf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.534290:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2addf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.534304:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638543.534308:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2addf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.534316:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2addf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.534341:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:3.0:1788638543.534345:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788638543.534349:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2addf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.534355:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2addf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.534390:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2ad14 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.534397:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2ad14 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.534403:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2ad14 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.534408:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638543.534411:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2ad14 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.534416:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2ad14 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.534435:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81100) 00010000:00010000:3.0:1788638543.534437:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788638543.534441:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2ad14 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.534446:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2ad14 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.534471:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ade6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.534484:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2ad30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434eb6 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.534492:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ade6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.534517:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2ad30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434eb6 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.534530:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2ad30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434eb6 expref: 17 pid: 5843 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638543.534540:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875523183643392:192.168.203.34@tcp:104: 00000100:00100000:3.0:1788638543.534589:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73856103c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638543.534912:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 45 00000100:00100000:1.0:1788638543.541929:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638543.541955:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875523183643392:192.168.203.34@tcp:104: 00010000:00010000:3.0:1788638543.541983:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ade6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638543.542103:0:11689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174182144 00000100:00100000:2.0:1788638543.542110:0:11689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174182144 00010000:00010000:2.0:1788638543.542146:0:11689:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2ad30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434eb6 expref: 17 pid: 5843 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638543.542181:0:11689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 46 00000100:00100000:2.0:1788638543.542189:0:11689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+17:2364:x1875523174182144:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638543.542202:0:11689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638543.542208:0:11689:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2ad30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434eb6 expref: 17 pid: 5843 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.542219:0:11689:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2ad30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434eb6 expref: 17 pid: 5843 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.542239:0:11689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2ad30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434eb6 expref: 17 pid: 5843 timeout: 406 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.542254:0:11689:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81100) 00010000:00010000:2.0:1788638543.542258:0:11689:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ade6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.542268:0:11689:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ade6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.542275:0:11689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ade6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.542294:0:11689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638543.542503:0:11689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+16:2364:x1875523174182144:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 313us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638543.542512:0:11689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 46 00010000:00010000:3.0:1788638543.542679:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ade6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.542689:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ade6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.542702:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ade6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.542709:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ade6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.542715:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ade6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.542722:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638543.542727:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ade6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.542734:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ade6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.542745:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81100) 00010000:00010000:3.0:1788638543.542748:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638543.542752:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ade6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.542758:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ade6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.542770:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2add8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.542806:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2add8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.542813:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2add8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.542817:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638543.542820:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2add8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.542827:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2add8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.542836:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81100) 00010000:00010000:3.0:1788638543.542839:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788638543.542842:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2add8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.542847:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2add8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638543.543048:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+15:10469:x1875523174181888:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 Request processed in 20774us (23030us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1788638543.543058:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 83 00000020:00080000:3.0:1788638543.543062:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1788638543.543188:0:11706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788638543.543193:0:11706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788638543.543221:0:11706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788638543.543227:0:11706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788638543.561662:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638543.561739:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174182400 00000100:00100000:0.0:1788638543.561749:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174182400 00000100:00100000:0.0:1788638543.561815:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 20 00000100:00100000:0.0:1788638543.561825:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+15:10469:x1875523174182400:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788638543.563274:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788638543.563424:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1788638543.563485:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aded lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.563503:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aded lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.563516:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aded lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.563526:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aded lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.563533:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aded lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.563541:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aded lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638543.563618:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788638543.563729:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+17:10469:x1875523174182400:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 Request processed in 1901us (2072us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788638543.563739:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 20 00000020:00080000:0.0:1788638543.563744:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788638543.563815:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638543.563822:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aded lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.563829:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d800 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638543.563833:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aded lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.563841:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aded lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.563855:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9c73a1cf7900) 00010000:00010000:2.0:1788638543.563858:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788638543.563863:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aded lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.563869:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aded lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.563885:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638543.563887:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638543.563889:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788638543.631257:0:12029:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788638543.631268:0:12029:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788638543.631306:0:12029:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788638543.631311:0:12029:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788638543.776590:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638543.828464:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638543.828599:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174182656 00000100:00100000:3.0:1788638543.828622:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174182656 00000100:00100000:3.0:1788638543.828685:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 84 00000100:00100000:3.0:1788638543.828696:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+17:10479:x1875523174182656:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:3.0:1788638543.828721:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638543.828744:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2adf4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434eee expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.828883:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2adfb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.828897:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2adfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.828909:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2adfb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638543.828920:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788638543.829029:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2adf4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434eee expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.829047:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2adfb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434eee expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.829056:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:3.0:1788638543.829060:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788638543.829063:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031c00, rc 0) 00000100:00100000:3.0:1788638543.829116:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+19:10479:x1875523174182656:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 423us (662us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1788638543.829123:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 84 00000100:00100000:0.0:1788638543.844362:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638543.851590:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174182784 00000100:00100000:1.0:1788638543.851606:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174182784 00000100:00100000:1.0:1788638543.851669:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 85 00000100:00100000:1.0:1788638543.851681:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+19:10479:x1875523174182784:12345-192.168.203.34@tcp:34:lfs.0 00010000:00010000:1.0:1788638543.851757:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2ae09 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.851776:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2ae09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.851805:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2ae09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.851822:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2ae10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.851830:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2ae10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.851838:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2ae10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852083:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2ae17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852097:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2ae17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852105:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2ae17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788638543.852147:0:7634:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2ae17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852159:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2ae09 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852164:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2ae09 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852170:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2ae09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852174:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638543.852178:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2ae09 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852184:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2ae09 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852194:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:1.0:1788638543.852197:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638543.852202:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2ae09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852208:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2ae09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852225:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2ae10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852231:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2ae10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852237:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2ae10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852242:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638543.852245:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2ae10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852250:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2ae10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852257:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c7398420e00) 00010000:00010000:1.0:1788638543.852260:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638543.852262:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2ae10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852268:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2ae10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852292:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2ae17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852298:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2ae17 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852303:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2ae17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852314:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638543.852318:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2ae17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852333:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2ae17 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852342:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7398420a00) 00010000:00010000:1.0:1788638543.852344:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638543.852347:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2ae17 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638543.852353:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2ae17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638543.852437:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+19:10479:x1875523174182784:12345-192.168.203.34@tcp:34:lfs.0 Request processed in 757us (8084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638543.852445:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 85 00000100:00100000:1.0:1788638543.930145:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638543.930212:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174183040 00000100:00100000:3.0:1788638543.930222:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174183040 00000100:00100000:3.0:1788638543.930301:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 86 00000100:00100000:3.0:1788638543.930311:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+19:10482:x1875523174183040:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:3.0:1788638543.930341:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638543.930363:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ae1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434ef5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.930434:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ae25 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.930449:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ae25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.930462:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ae25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.930476:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ae2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.930483:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ae2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.930489:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ae2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.930736:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2ae33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.930745:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2ae33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.930764:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2ae33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638543.930775:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788638543.930890:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ae25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.931266:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ae25 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.931274:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ae25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.931350:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638543.931355:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ae25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.931362:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ae25 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.931374:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:3.0:1788638543.931377:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638543.931381:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ae25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.931387:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2ae25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.931400:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ae2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.931406:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ae2c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.931419:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ae2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.931478:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638543.931482:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ae2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.931488:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ae2c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.931498:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c7393e81100) 00010000:00010000:3.0:1788638543.931500:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638543.931503:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ae2c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.931508:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2ae2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.931555:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ae1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ef5 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.931569:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2ae33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ef5 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638543.931576:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81200) 00010000:00010000:3.0:1788638543.931578:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788638543.931581:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030000, rc 0) 00000100:00100000:3.0:1788638543.931690:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+21:10482:x1875523174183040:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 1379us (1551us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788638543.931709:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 86 00000100:00100000:1.0:1788638543.942074:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638543.942624:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174183168 00000100:00100000:2.0:1788638543.942643:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174183168 00000100:00100000:2.0:1788638543.942695:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 87 00000100:00100000:2.0:1788638543.942705:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+21:10482:x1875523174183168:12345-192.168.203.34@tcp:54:lfs.0 00010000:00010000:2.0:1788638543.942767:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ae41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.942819:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ae41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.942832:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ae41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.942858:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ae41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.942864:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ae41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.942871:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ae41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.942877:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638543.942881:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ae41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.942889:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ae41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.942900:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81200) 00010000:00010000:2.0:1788638543.942903:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788638543.942907:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ae41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638543.942913:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ae41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638543.942981:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+21:10482:x1875523174183168:12345-192.168.203.34@tcp:54:lfs.0 Request processed in 277us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638543.942996:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 87 00000100:00100000:0.0:1788638543.945608:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638543.945663:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174183424 00000100:00100000:1.0:1788638543.945673:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174183424 00000100:00100000:1.0:1788638543.945725:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 21 00000100:00100000:1.0:1788638543.945736:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73a5715c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+21:10482:x1875523174183424:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:1.0:1788638543.946012:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73a5715c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+22:10482:x1875523174183424:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 277us (411us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1788638543.946020:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 21 00000100:00100000:1.0:1788638544.000885:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638544.000996:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174183680 00000100:00100000:2.0:1788638544.001006:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174183680 00000100:00100000:2.0:1788638544.001066:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 88 00000100:00100000:2.0:1788638544.001077:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+22:10011:x1875523174183680:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:2.0:1788638544.001100:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638544.001121:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ae48 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434efc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.001218:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ae4f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.001233:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2ae33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ef5 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.001242:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ae4f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.001278:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2ae33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ef5 expref: 23 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.001291:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2ae33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ef5 expref: 23 pid: 5842 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638544.001305:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7da3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875523183643520:192.168.203.34@tcp:104: 00000100:00100000:2.0:1788638544.001402:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384e6be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788638544.007374:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638544.007538:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174183808 00000100:00100000:1.0:1788638544.007549:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174183808 00010000:00010000:1.0:1788638544.007589:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2ae33 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ef5 expref: 24 pid: 5842 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638544.007634:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 47 00000100:00100000:1.0:1788638544.007644:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+24:2364:x1875523174183808:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638544.007665:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638544.007673:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2ae33 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ef5 expref: 24 pid: 5842 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.007687:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2ae33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ef5 expref: 24 pid: 5842 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.007710:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81200) 00010000:00010000:1.0:1788638544.007716:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ae4f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.007727:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ae4f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.007736:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ae4f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.007755:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638544.007842:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+24:2364:x1875523174183808:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 199us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638544.007849:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 47 00010000:00010000:2.0:1788638544.007970:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2ae33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ef5 expref: 23 pid: 5842 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638544.008002:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7da3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875523183643520:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638544.008026:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ae4f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.008034:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ae4f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.008040:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ae4f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638544.008059:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788638544.008201:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ae48 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434efc expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.008216:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ae4f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434efc expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.008223:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81200) 00010000:00010000:2.0:1788638544.008226:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788638544.008229:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6600, rc 0) 00000100:00100000:2.0:1788638544.008271:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+23:10011:x1875523174183680:12345-192.168.203.34@tcp:101:bash.0 Request processed in 7196us (7394us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788638544.008278:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 88 00000100:00100000:0.0:1788638544.016395:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638544.016490:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174184064 00000100:00100000:2.0:1788638544.016500:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174184064 00000100:00100000:2.0:1788638544.016558:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 89 00000100:00100000:2.0:1788638544.016567:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+23:10011:x1875523174184064:12345-192.168.203.34@tcp:36:bash.0 00010000:00010000:2.0:1788638544.016879:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ae5d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.016897:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ae5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.016909:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ae5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788638544.016961:0:7634:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1788638544.016986:0:7634:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebaf7db5 reply state 000000002abe8ef8 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ae5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638544.016995:0:7634:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788638544.017041:0:7634:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1788638544.017152:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+27:10011:x1875523174184064:12345-192.168.203.34@tcp:36:bash.0 Request processed in 574us (755us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1788638544.017160:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 89 00000020:00080000:2.0:1788638544.017165:0:7634:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1788638544.020145:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ae5d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.020207:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ae5d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.020216:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ae5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.020223:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638544.020227:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ae5d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.020236:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ae5d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.020314:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81200) 00010000:00010000:1.0:1788638544.020326:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638544.020332:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ae5d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.020339:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2ae5d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638544.030356:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638544.034422:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174184192 00000100:00100000:3.0:1788638544.034437:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174184192 00000100:00100000:3.0:1788638544.034505:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 90 00000100:00100000:3.0:1788638544.034515:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+26:10011:x1875523174184192:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:3.0:1788638544.034535:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638544.034553:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ae64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434f03 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.034608:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ae64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f03 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.034624:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ae64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f03 expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.034641:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81200) 00010000:00010000:3.0:1788638544.034644:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788638544.034648:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031400, rc 0) 00000100:00100000:3.0:1788638544.038645:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+27:10011:x1875523174184192:12345-192.168.203.34@tcp:101:bash.0 Request processed in 4119us (8286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638544.038658:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 90 00000100:00100000:2.0:1788638544.050137:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638544.050444:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174184320 00000100:00100000:0.0:1788638544.050454:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174184320 00000100:00100000:0.0:1788638544.050516:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 33 00000100:00100000:0.0:1788638544.050527:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:10011:x1875523174184320:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:0.0:1788638544.050546:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638544.050566:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000610063e8/0xa0b1f1e3b4b2ae6b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434f0a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788638544.050594:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c754e, atime: 0x6a9c754c, ctime: 0x6a9c754e, blocks: 0xb 00010000:00010000:0.0:1788638544.050615:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=307s v=(0 0) 00010000:00010000:0.0:1788638544.050619:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638544.050627:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000610063e8/0xa0b1f1e3b4b2ae6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f0a expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.050664:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000610063e8/0xa0b1f1e3b4b2ae6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f0a expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.050678:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01ca00, rc 0) 00000100:00100000:0.0:1788638544.050739:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+7:10011:x1875523174184320:12345-192.168.203.34@tcp:101:bash.0 Request processed in 214us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638544.050746:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 33 00000100:00100000:1.0:1788638544.056057:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638544.061459:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174184448 00000100:00100000:0.0:1788638544.061475:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174184448 00002000:00010000:0.0:1788638544.061525:0:6690:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1788638544.061530:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c73ad6c2a00 with x1875523174184448 ext(0->18446744073709551615) 00002000:00010000:0.0:1788638544.061541:0:6690:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c73ad6c2a00. 00000100:00100000:0.0:1788638544.061579:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 1 00000100:00100000:0.0:1788638544.061589:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2367:x1875523174184448:12345-192.168.203.34@tcp:10:bash.0 00002000:00010000:0.0:1788638544.061866:0:6690:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1788638544.061870:0:6690:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788638542 -> 1788638544 00002000:00010000:0.0:1788638544.061873:0:6690:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788638540 -> 1788638540 00002000:00010000:0.0:1788638544.061875:0:6690:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788638542 -> 1788638544 00002000:00010000:0.0:1788638544.061877:0:6690:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1788638544.062079:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2367:x1875523174184448:12345-192.168.203.34@tcp:10:bash.0 Request processed in 490us (6030us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788638544.062086:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 1 00002000:00010000:0.0:1788638544.062090:0:6690:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1788638544.062093:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c73ad6c2a00 with x1875523174184448 ext(0->18446744073709551615) 00002000:00010000:0.0:1788638544.062110:0:6690:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c73ad6c2a00. 00000100:00100000:3.0:1788638544.211639:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638544.211743:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174184576 00000100:00100000:2.0:1788638544.211752:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174184576 00000100:00100000:2.0:1788638544.211843:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 91 00000100:00100000:2.0:1788638544.211854:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+27:10496:x1875523174184576:12345-192.168.203.34@tcp:34:lfs.0 00010000:00010000:2.0:1788638544.211937:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ae72 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.211956:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ae72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.211968:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ae72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.211999:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2ae79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212007:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2ae79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212014:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2ae79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212251:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2ae80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212260:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2ae80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212267:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2ae80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788638544.212315:0:7634:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2ae80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212335:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ae72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212342:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ae72 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212349:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ae72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212354:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638544.212359:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ae72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212373:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ae72 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212386:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:2.0:1788638544.212389:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638544.212394:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ae72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212400:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2ae72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212414:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2ae79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212420:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2ae79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212425:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2ae79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212430:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638544.212432:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2ae79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212438:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2ae79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212445:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c738a6e9700) 00010000:00010000:2.0:1788638544.212447:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638544.212449:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2ae79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212464:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2ae79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212479:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2ae80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212486:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2ae80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212491:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2ae80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212496:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638544.212499:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2ae80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212505:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2ae80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212512:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81200) 00010000:00010000:2.0:1788638544.212515:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638544.212518:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2ae80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.212523:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2ae80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638544.212603:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+27:10496:x1875523174184576:12345-192.168.203.34@tcp:34:lfs.0 Request processed in 750us (972us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638544.212611:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 91 00000100:00100000:2.0:1788638544.283912:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638544.284052:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174184832 00000100:00100000:0.0:1788638544.284062:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174184832 00000100:00100000:0.0:1788638544.284121:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 92 00000100:00100000:0.0:1788638544.284131:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+27:10499:x1875523174184832:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638544.284152:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638544.284173:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ae87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434f11 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.284246:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2ae8e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.284260:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2ae8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.284273:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2ae8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.284297:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2ae95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.284305:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2ae95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.284312:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2ae95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.284825:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2ae9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.284836:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2ae9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.284852:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2ae9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638544.284863:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788638544.285022:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2ae8e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.285030:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2ae8e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.285038:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2ae8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.285044:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01cc00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638544.285048:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2ae8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.285055:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2ae8e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.285067:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:0.0:1788638544.285071:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638544.285075:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2ae8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.285080:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2ae8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.285092:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2ae95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.285098:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2ae95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.285109:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2ae95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.285114:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01da00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638544.285116:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2ae95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.285122:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2ae95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.285130:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c73a1cf7d00) 00010000:00010000:0.0:1788638544.285132:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638544.285135:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2ae95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.285140:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2ae95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.285184:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2ae87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f11 expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.285198:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2ae9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f11 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.285205:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81200) 00010000:00010000:0.0:1788638544.285207:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788638544.285210:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01d200, rc 0) 00000100:00100000:0.0:1788638544.285493:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+29:10499:x1875523174184832:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 1362us (1597us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1788638544.285512:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 92 00000100:00100000:1.0:1788638544.306723:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638544.306817:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174184960 00000100:00100000:2.0:1788638544.306826:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174184960 00000100:00100000:2.0:1788638544.306887:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 93 00000100:00100000:2.0:1788638544.306907:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+29:10499:x1875523174184960:12345-192.168.203.34@tcp:54:lfs.0 00010000:00010000:2.0:1788638544.306973:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2aeaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.306992:0:7634:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ae4f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434efc expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.307002:0:7634:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2aeaa lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.307037:0:7634:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ae4f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434efc expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.307051:0:7634:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ae4f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434efc expref: 29 pid: 5843 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638544.307066:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7da1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7634:1875523183643648:192.168.203.34@tcp:104: 00000100:00100000:2.0:1788638544.307165:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73c0a369c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638544.315188:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638544.315272:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174185216 00000100:00100000:0.0:1788638544.315290:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174185216 00000100:00100000:0.0:1788638544.315355:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 22 00000100:00100000:0.0:1788638544.315365:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+30:5605:x1875523174185216:12345-192.168.203.34@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788638544.315673:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+31:5605:x1875523174185216:12345-192.168.203.34@tcp:35:ldlm_bl.0 Request processed in 308us (493us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788638544.315681:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 22 00000100:00100000:2.0:1788638544.316511:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7da1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7634:1875523183643648:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638544.316542:0:7634:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2aeaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638544.319012:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638544.319111:0:11689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174185344 00000100:00100000:2.0:1788638544.319121:0:11689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174185344 00010000:00010000:2.0:1788638544.319173:0:11689:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ae4f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434efc expref: 31 pid: 5843 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638544.319216:0:11689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 48 00000100:00100000:2.0:1788638544.319225:0:11689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+31:2364:x1875523174185344:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638544.319241:0:11689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638544.319248:0:11689:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ae4f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434efc expref: 31 pid: 5843 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.319260:0:11689:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ae4f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434efc expref: 31 pid: 5843 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.319297:0:11689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2ae4f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434efc expref: 31 pid: 5843 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.319313:0:11689:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81200) 00010000:00010000:2.0:1788638544.319328:0:11689:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2aeaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.319338:0:11689:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2aeaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.319345:0:11689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2aeaa lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.319380:0:11689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638544.319439:0:11689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+30:2364:x1875523174185344:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 215us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638544.319446:0:11689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 48 00010000:00010000:1.0:1788638544.319732:0:7634:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2aeaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.319742:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2aeaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.319771:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2aeaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.319829:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2aeaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.319837:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2aeaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.319843:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638544.319847:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2aeaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.319854:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2aeaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.319865:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81200) 00010000:00010000:1.0:1788638544.319868:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788638544.319871:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2aeaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.319877:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2aeaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638544.319923:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+29:10499:x1875523174184960:12345-192.168.203.34@tcp:54:lfs.0 Request processed in 13019us (13210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638544.319931:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 93 00000100:00100000:3.0:1788638544.322399:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638544.322506:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174185600 00000100:00100000:0.0:1788638544.322515:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174185600 00000100:00100000:0.0:1788638544.322565:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 23 00000100:00100000:0.0:1788638544.322575:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+29:10499:x1875523174185600:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:0.0:1788638544.322851:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+30:10499:x1875523174185600:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 276us (460us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1788638544.322860:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 23 00000100:00100000:0.0:1788638544.460299:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638544.460621:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174185856 00000100:00100000:3.0:1788638544.460630:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174185856 00000100:00100000:3.0:1788638544.460708:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 94 00000100:00100000:3.0:1788638544.460718:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+30:10510:x1875523174185856:12345-192.168.203.34@tcp:101:cat.0 00010000:00010000:3.0:1788638544.460744:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638544.460765:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2aeb1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434f18 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.460878:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2aeb8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.460895:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2aeb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.460906:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2aeb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.460923:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2aebf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.461141:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2aebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.461149:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2aebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.461658:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2aec6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.461668:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2aec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.461741:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2aec6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638544.461762:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1788638544.462084:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2aeb8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.462093:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2aeb8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.462099:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2aeb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.462105:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638544.462109:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2aeb8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.462117:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2aeb8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.462129:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:3.0:1788638544.462132:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638544.462136:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2aeb8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.462142:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2aeb8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.462759:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2aebf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.462769:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2aebf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.462874:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2aebf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.462881:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638544.462885:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2aebf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.462892:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2aebf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.462901:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c7393e81100) 00010000:00010000:3.0:1788638544.462904:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638544.462907:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2aebf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.462913:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2aebf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.462983:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2aeb1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f18 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.462997:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2aec6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f18 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.463003:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81200) 00010000:00010000:3.0:1788638544.463005:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788638544.463008:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030c00, rc 0) 00000100:00100000:3.0:1788638544.463080:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+32:10510:x1875523174185856:12345-192.168.203.34@tcp:101:cat.0 Request processed in 2363us (2801us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788638544.463098:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 94 00000100:00100000:2.0:1788638544.473426:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638544.475222:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174186112 00000100:00100000:0.0:1788638544.475236:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174186112 00000100:00100000:0.0:1788638544.475296:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 24 00000100:00100000:0.0:1788638544.475306:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+32:10510:x1875523174186112:12345-192.168.203.34@tcp:35:cat.0 00000100:00100000:0.0:1788638544.475541:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+33:10510:x1875523174186112:12345-192.168.203.34@tcp:35:cat.0 Request processed in 235us (2122us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788638544.475549:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 24 00000100:00100000:2.0:1788638544.504130:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638544.504273:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174186368 00000100:00100000:0.0:1788638544.504307:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174186368 00000100:00100000:0.0:1788638544.504375:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 95 00000100:00100000:0.0:1788638544.504386:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+33:10511:x1875523174186368:12345-192.168.203.34@tcp:36:rm.0 00010000:00010000:0.0:1788638544.504443:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788638544.504468:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2aec6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f18 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.504492:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2ae9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f11 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.504505:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2ae64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f03 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.504515:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c7393e81200) 00010000:00010000:0.0:1788638544.504525:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788638544.504546:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2aed4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.504559:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2aed4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.504568:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2aed4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.504581:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2aedb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.504587:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2aedb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.504593:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2aedb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.504866:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aee2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.504874:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aee2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.504881:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aee2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788638544.505501:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1788638544.505511:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 307576727994ns, next at 308576725604ns, rc = 0 00010000:00010000:1.0:1788638544.516209:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2aee9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.516238:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2aee9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.516252:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2aee9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.516356:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2aee9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.516365:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2aee9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.516371:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2aee9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.516395:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788638544.516435:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aee2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.516441:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aee2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.516447:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aee2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.516453:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638544.516457:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aee2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.516464:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aee2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.516486:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c73a1cf7500) 00010000:00010000:1.0:1788638544.516490:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788638544.516495:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aee2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.516512:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2aee2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.516534:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2aed4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.516540:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2aed4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.516546:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2aed4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.516552:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01cc00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638544.516554:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2aed4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.516560:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2aed4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.516568:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:1.0:1788638544.516571:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638544.516575:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2aed4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.516580:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01cc00/0xa0b1f1e3b4b2aed4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788638544.516591:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006c631471 reply state 00000000249b28b2 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2aedb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638544.516599:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788638544.516801:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+32:10511:x1875523174186368:12345-192.168.203.34@tcp:36:rm.0 Request processed in 12392us (12656us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1788638544.516811:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 95 00010000:00010000:0.0:1788638544.517063:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638544.517070:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2aee9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.517076:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638544.517080:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2aee9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.517086:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2aee9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.517095:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9c73a1cf7500) 00010000:00010000:0.0:1788638544.517098:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788638544.517101:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2aee9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.517107:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2aee9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.517122:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638544.517129:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638544.517131:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638544.522617:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2aedb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.522634:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2aedb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.522642:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2aedb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.522648:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638544.522652:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2aedb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.522661:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2aedb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.522683:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c73a1cf7d00) 00010000:00010000:3.0:1788638544.522686:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638544.522691:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2aedb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.522698:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2aedb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788638544.552023:0:11706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788638544.552033:0:11706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788638544.552246:0:11706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788638544.552255:0:11706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788638544.621162:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638544.623306:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174186624 00000100:00100000:0.0:1788638544.623327:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174186624 00000100:00100000:0.0:1788638544.623406:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 96 00000100:00100000:0.0:1788638544.623417:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+31:10517:x1875523174186624:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:0.0:1788638544.623439:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638544.623460:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2aef0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434f1f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.624147:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2aef7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.624165:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2aef7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.624176:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2aef7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.624190:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aefe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.624197:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aefe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.624204:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aefe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788638544.627424:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:0.0:1788638544.627637:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2af05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.627670:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2af05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.627683:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2af05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.627721:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2aef7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.627729:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2aef7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.627736:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2aef7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.627742:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01ce00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638544.627747:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2aef7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.627754:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2aef7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.627767:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:0.0:1788638544.627770:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638544.627774:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2aef7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.627780:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2aef7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788638544.627815:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e578906d reply state 0000000053750013 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aefe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638544.627843:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788638544.627878:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2aef0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f1f expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.627894:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2af05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f1f expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.627902:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c73a1cf7000) 00010000:00010000:0.0:1788638544.627904:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788638544.627906:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01d000, rc 0) 00000100:00100000:0.0:1788638544.627994:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+34:10517:x1875523174186624:12345-192.168.203.34@tcp:101:bash.0 Request processed in 4579us (6841us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1788638544.628002:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 96 00010000:00010000:1.0:1788638544.634662:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aefe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.634689:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aefe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.634697:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aefe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.634702:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638544.634707:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aefe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.634715:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aefe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.634733:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c73a1cf7500) 00010000:00010000:1.0:1788638544.634736:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638544.634741:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aefe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.634749:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2aefe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638544.636944:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638544.638072:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174186752 00000100:00100000:0.0:1788638544.638088:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174186752 00000100:00100000:0.0:1788638544.638150:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 34 00000100:00100000:0.0:1788638544.638159:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2364:x1875523174186752:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:0.0:1788638544.638175:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638544.638196:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2af13 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434f26 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788638544.638224:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638544.638243:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=307s v=(0 0) 00010000:00010000:0.0:1788638544.638247:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638544.638256:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2af13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f26 expref: 6 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.639989:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2af13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f26 expref: 6 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.640005:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01cc00, rc 0) 00000100:00100000:0.0:1788638544.640081:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174186752:12345-192.168.203.34@tcp:101:bash.0 Request processed in 1922us (3144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638544.640089:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 34 00000100:00100000:2.0:1788638544.646506:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638544.647017:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174186880 00000100:00100000:0.0:1788638544.647031:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174186880 00000100:00100000:0.0:1788638544.647107:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 35 00000100:00100000:0.0:1788638544.647118:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:10517:x1875523174186880:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:0.0:1788638544.647143:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638544.647167:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2af1a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434f2d expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.647208:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2af13 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f26 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.647218:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638544.647223:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638544.647229:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2af1a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f2d expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.647296:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2af13 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f26 expref: 7 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.647341:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2af13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f26 expref: 7 pid: 6686 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638544.647358:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6684:1875523183643776:192.168.203.34@tcp:104: 00000100:00100000:0.0:1788638544.647487:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bf299cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638544.652989:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638544.653476:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174187008 00000100:00100000:1.0:1788638544.653488:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174187008 00010000:00010000:1.0:1788638544.653542:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2af13 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f26 expref: 8 pid: 6686 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638544.653614:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 49 00000100:00100000:1.0:1788638544.653625:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dfa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2365:x1875523174187008:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638544.653645:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638544.653671:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2af13 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f26 expref: 8 pid: 6686 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.653749:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2af13 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f26 expref: 8 pid: 6686 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.653820:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638544.653825:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638544.653835:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2af1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f2d expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.653847:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2af1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f2d expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.653892:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2af1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f2d expref: 8 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.654106:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2af13 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f26 expref: 8 pid: 6686 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638544.654126:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6684:1875523183643776:192.168.203.34@tcp:104: 00010000:00010000:0.0:1788638544.654159:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2af1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f2d expref: 7 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.654171:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01d200, rc 0) 00000100:00100000:0.0:1788638544.654228:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+7:10517:x1875523174186880:12345-192.168.203.34@tcp:101:bash.0 Request processed in 7113us (7738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638544.654497:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5829:1875523183643904:192.168.203.34@tcp:105: 00000100:00100000:1.0:1788638544.654563:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387969b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788638544.658573:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 35 00000100:00100000:1.0:1788638544.663731:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c0000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5829:1875523183643904:192.168.203.34@tcp:105: 00010000:00010000:1.0:1788638544.663835:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638544.663912:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dfa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2365:x1875523174187008:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 10270us (10921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638544.663924:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 49 00000100:00100000:3.0:1788638544.670252:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638544.670362:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174187264 00000100:00100000:0.0:1788638544.670376:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174187264 00000100:00100000:0.0:1788638544.670450:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 25 00000100:00100000:0.0:1788638544.670462:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+33:10517:x1875523174187264:12345-192.168.203.34@tcp:35:bash.0 00000100:00100000:0.0:1788638544.670977:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+34:10517:x1875523174187264:12345-192.168.203.34@tcp:35:bash.0 Request processed in 515us (737us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788638544.670987:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 25 00010000:00010000:1.0:1788638544.800234:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638544.923867:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638544.924172:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174187392 00000100:00100000:1.0:1788638544.924183:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174187392 00000100:00100000:1.0:1788638544.924244:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 97 00000100:00100000:1.0:1788638544.924254:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+34:10533:x1875523174187392:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:1.0:1788638544.924278:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638544.924407:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2af21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434f34 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.924466:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2af28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.924481:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2af28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.924493:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2af28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788638544.924527:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788638544.924531:0:7634:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788638544.924549:0:7634:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2af28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.924575:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2af21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f34 expref: 36 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.924613:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2af28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f34 expref: 35 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.924622:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:1.0:1788638544.924624:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788638544.924628:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309c00, rc 0) 00000100:00100000:1.0:1788638544.924887:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+35:10533:x1875523174187392:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 633us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638544.924895:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 97 00000100:00100000:3.0:1788638544.934309:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638544.934446:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174187648 00000100:00100000:2.0:1788638544.934457:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174187648 00000100:00100000:2.0:1788638544.934515:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 98 00000100:00100000:2.0:1788638544.934526:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+35:10533:x1875523174187648:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:2.0:1788638544.934549:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638544.934570:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2af2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434f3b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.934684:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2af36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.934700:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2af36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.934713:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2af36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638544.934724:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788638544.934880:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2af2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f3b expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.934918:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2af36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f3b expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.934927:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c73a1cf7000) 00010000:00010000:2.0:1788638544.934930:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788638544.934933:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6a00, rc 0) 00000100:00100000:2.0:1788638544.935001:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4890380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+37:10533:x1875523174187648:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 476us (701us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788638544.935008:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 98 00000100:00100000:3.0:1788638544.938260:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638544.938341:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638544.938531:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174188032 00000100:00100000:1.0:1788638544.938541:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174188032 00000100:00100000:1.0:1788638544.938596:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 99 00000100:00100000:1.0:1788638544.938606:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+37:10533:x1875523174188032:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:1.0:1788638544.938630:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638544.938661:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2af44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434f42 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.938762:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2af4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.938778:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2af4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.938825:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2af4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788638544.938836:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788638544.938972:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2af44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f42 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.938991:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2af4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f42 expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638544.939000:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c73a1cf7000) 00010000:00010000:1.0:1788638544.939003:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788638544.939006:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385308000, rc 0) 00000100:00100000:1.0:1788638544.939271:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4892a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+39:10533:x1875523174188032:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 664us (928us total) trans 4294967379 rc 0/0 00000100:00100000:1.0:1788638544.939284:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 99 00000100:00100000:2.0:1788638544.939832:0:11689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174187776 00000100:00100000:2.0:1788638544.939841:0:11689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174187776 00000100:00100000:2.0:1788638544.939887:0:11689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00100000:2.0:1788638544.939906:0:11689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4893800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+39:2364:x1875523174187776:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638544.939918:0:11689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638544.939937:0:11689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2af36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f3b expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.939951:0:11689:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c73a1cf7000) 00010000:00010000:2.0:1788638544.939955:0:11689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638544.939987:0:11689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4893800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+38:2364:x1875523174187776:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 83us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638544.939993:0:11689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00100000:2.0:1788638544.944774:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638544.944880:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174188160 00000100:00100000:3.0:1788638544.944889:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174188160 00000100:00100000:3.0:1788638544.944946:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 36 00000100:00100000:3.0:1788638544.944956:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2365:x1875523174188160:12345-192.168.203.34@tcp:1:lfs.0 00010000:00010000:3.0:1788638544.944997:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2af59 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.945017:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2af1a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f2d expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.945025:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788638544.945040:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788638544.945045:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2af59 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.945079:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2af1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f2d expref: 6 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.945091:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2af1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f2d expref: 6 pid: 6684 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638544.945106:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4890700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1875523183644032:192.168.203.34@tcp:104: 00000100:00100000:3.0:1788638544.945198:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73856103c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638544.948571:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638544.948648:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174188288 00000100:00100000:3.0:1788638544.948658:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174188288 00002000:00100000:3.0:1788638544.948707:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9c73b7c44700 x1875523174188288/t0(0) o4->00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp:520/0 lens 504/0 e 0 to 0 dl 1788638555 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788638544.948732:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c73b7c44700 with x1875523174188288 ext(0->8) 00010000:00010000:3.0:1788638544.948755:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2af1a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f2d expref: 7 pid: 6684 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.948771:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2af1a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f2d expref: 7 pid: 6684 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788638544.948779:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c73b7c44700 00000100:00100000:3.0:1788638544.948834:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 1 00000100:00100000:3.0:1788638544.948843:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2365:x1875523174188288:12345-192.168.203.34@tcp:4:lfs.0 00000100:00100000:3.0:1788638544.949694:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+9:2365:x1875523174188288:12345-192.168.203.34@tcp:4:lfs.0 Request processed in 848us (1129us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788638544.949702:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 1 00002000:00100000:3.0:1788638544.949710:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9c73b7c44700 x1875523174188288/t4294967302(0) o4->00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp:520/0 lens 504/448 e 0 to 0 dl 1788638555 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788638544.949718:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c73b7c44700 with x1875523174188288 ext(0->8) 00010000:00010000:3.0:1788638544.949726:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2af1a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f2d expref: 9 pid: 6684 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638544.949741:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2af1a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f2d expref: 9 pid: 6684 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788638544.949748:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c73b7c44700 00000100:00100000:0.0:1788638544.950305:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4890700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1875523183644032:192.168.203.34@tcp:104: 00010000:00010000:0.0:1788638544.950339:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2af59 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638544.958167:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638544.958333:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174188416 00000100:00100000:2.0:1788638544.958350:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174188416 00010000:00010000:2.0:1788638544.958389:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2af1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f2d expref: 9 pid: 6684 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638544.958431:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 50 00000100:00100000:2.0:1788638544.958440:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4891c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+9:2366:x1875523174188416:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638544.958454:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788638544.958471:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788638544.958475:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788638544 00002000:00010000:2.0:1788638544.958477:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788638545 00002000:00010000:2.0:1788638544.958479:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788638544 00010000:00010000:2.0:1788638544.958485:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2af1a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f2d expref: 9 pid: 6684 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.958499:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2af1a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f2d expref: 9 pid: 6684 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.958522:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2af1a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f2d expref: 9 pid: 6684 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.958540:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788638544.958544:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788638544.958550:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2af59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.958560:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2af59 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.958606:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638544.958664:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4891c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2366:x1875523174188416:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 224us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638544.958671:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 50 00010000:00010000:0.0:1788638544.959163:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2af59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.959175:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2af59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.959200:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2af59 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.959207:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2af59 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.959215:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2af59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.959222:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030e00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638544.959226:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2af59 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.959235:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2af59 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.959259:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2af59 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.959267:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007abf01ca/0xa0b1f1e3b4b2af59 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638544.959344:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2365:x1875523174188160:12345-192.168.203.34@tcp:1:lfs.0 Request processed in 14389us (14579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638544.959352:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 36 00000100:00100000:2.0:1788638544.963223:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638544.963281:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174188672 00000100:00100000:0.0:1788638544.963291:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174188672 00000100:00100000:0.0:1788638544.963353:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 26 00000100:00100000:0.0:1788638544.963362:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73a5716050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+38:10533:x1875523174188672:12345-192.168.203.34@tcp:35:lfs.0 00000004:00010000:0.0:1788638544.963419:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2af4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f42 expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788638544.963671:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1788638544.963714:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1788638544.964025:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1788638544.964073:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2af60 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.964087:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2af05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f1f expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.964096:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2af60 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.964133:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2af05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f1f expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.964147:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2af05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f1f expref: 42 pid: 5843 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638544.964161:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1875523183644160:192.168.203.34@tcp:104: 00000100:00100000:0.0:1788638544.964243:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bf299480 going to sleep for 11 seconds 00000100:00100000:0.0:1788638544.968454:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d4380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1875523183644160:192.168.203.34@tcp:104: 00010000:00010000:0.0:1788638544.968496:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2af60 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638544.970759:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638544.971440:0:11689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174188800 00000100:00100000:0.0:1788638544.971451:0:11689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174188800 00010000:00010000:0.0:1788638544.971493:0:11689:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2af05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f1f expref: 43 pid: 5843 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638544.971536:0:11689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 51 00000100:00100000:0.0:1788638544.971546:0:11689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+43:2364:x1875523174188800:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788638544.971562:0:11689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638544.971569:0:11689:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2af05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f1f expref: 43 pid: 5843 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.971583:0:11689:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2af05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f1f expref: 43 pid: 5843 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.971625:0:11689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2af05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f1f expref: 43 pid: 5843 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.971641:0:11689:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c73a1cf7000) 00010000:00010000:0.0:1788638544.971646:0:11689:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2af60 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.971655:0:11689:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2af60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.971662:0:11689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2af60 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638544.971694:0:11689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788638544.971838:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2af60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.971847:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2af60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788638544.971982:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788638544.972371:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:2.0:1788638544.972494:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bbb78000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875523183644288:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788638544.972548:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638544.972581:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73866b1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638544.972668:0:11689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+44:2364:x1875523174188800:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 1121us (1924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638544.972677:0:11689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 51 00000100:00100000:1.0:1788638544.973002:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183644288 00000100:00100000:1.0:1788638544.973009:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183644288 00000100:00100000:1.0:1788638544.973058:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788638544.973067:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5846:x1875523183644288:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788638544.973130:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5846:x1875523183644288:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 65us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638544.973136:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788638544.973353:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bbb78000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875523183644288:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788638544.974182:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1788638544.974253:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bbb78000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875523183644416:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788638544.974334:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638544.974364:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73984f3c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788638544.974475:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183644416 00000100:00100000:1.0:1788638544.974482:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183644416 00000100:00100000:1.0:1788638544.974560:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788638544.974569:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5846:x1875523183644416:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788638544.974750:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5846:x1875523183644416:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 172us (406us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788638544.974759:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788638544.974827:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bbb78000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875523183644416:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788638544.974871:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1788638544.974915:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2af60 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.974938:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2af60 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.974945:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2af60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.974951:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01ce00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638544.974956:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2af60 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.974963:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2af60 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.974979:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c73a1cf7000) 00010000:00010000:2.0:1788638544.974983:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788638544.974988:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2af60 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.974995:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2af60 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788638544.977166:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788638544.977277:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1788638544.977289:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 308048505721ns, next at 309048502921ns, rc = 0 00000001:00080000:2.0:1788638544.977298:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1788638544.977370:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c73a1cf7000) 00010000:00010000:2.0:1788638544.977375:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788638544.977387:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2af4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f42 expref: 46 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638544.977520:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73a5716050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+45:10533:x1875523174188672:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 14156us (14302us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1788638544.977530:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 26 00000020:00080000:2.0:1788638544.977535:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788638544.984629:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638544.984689:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174188928 00000100:00100000:2.0:1788638544.984707:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174188928 00000100:00100000:2.0:1788638544.984828:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 100 00000100:00100000:2.0:1788638544.984839:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+45:10533:x1875523174188928:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:2.0:1788638544.984863:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638544.984896:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2af67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434f49 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.984960:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2af67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f49 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.984976:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2af67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f49 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638544.984995:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:2.0:1788638544.984998:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788638544.985002:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6000, rc 0) 00000100:00100000:2.0:1788638544.985086:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+46:10533:x1875523174188928:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 249us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638544.985093:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 100 00000100:00100000:3.0:1788638544.988214:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638544.990088:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174189184 00000100:00100000:1.0:1788638544.990135:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174189184 00000100:00100000:1.0:1788638544.990228:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 27 00000100:00100000:1.0:1788638544.990242:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+46:10533:x1875523174189184:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:1.0:1788638544.990600:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+47:10533:x1875523174189184:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 359us (2396us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1788638544.990610:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 27 00000100:00100000:3.0:1788638545.100956:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638545.101483:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174189312 00000100:00100000:1.0:1788638545.101494:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174189312 00000100:00100000:1.0:1788638545.101567:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 101 00000100:00100000:1.0:1788638545.101577:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+47:10543:x1875523174189312:12345-192.168.203.34@tcp:34:lfs.0 00010000:00010000:1.0:1788638545.101649:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2af6e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.101666:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2af6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.101678:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2af6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.101694:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2af75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.101701:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2af75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.101707:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2af75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788638545.102139:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788638545.106073:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2af7c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.106099:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2af7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.106111:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2af7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788638545.106173:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2af7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.106210:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2af6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.106218:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2af6e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.106226:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2af6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.106231:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638545.106236:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2af6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.106244:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2af6e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.106258:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:0.0:1788638545.106261:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638545.106265:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2af6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.106270:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2af6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.106286:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2af75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.106291:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2af75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.106297:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2af75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.106308:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638545.106974:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2af75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.106983:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2af75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.106993:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c7398420a00) 00010000:00010000:0.0:1788638545.106995:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638545.106999:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2af75 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.107005:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2af75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.107024:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2af7c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.107031:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2af7c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.107037:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2af7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.107042:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638545.107045:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2af7c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.107051:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2af7c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.107072:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:0.0:1788638545.107075:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638545.107078:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2af7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.107084:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2af7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638545.107179:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4890e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+47:10543:x1875523174189312:12345-192.168.203.34@tcp:34:lfs.0 Request processed in 5600us (6229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638545.107188:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 101 00000100:00100000:3.0:1788638545.121016:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183644928:0@lo:400:kworker.0 00000100:00100000:0.0:1788638545.121016:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183644672:0@lo:400:kworker.0 00000100:00100000:1.0:1788638545.121091:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183644544:0@lo:400:kworker.0 00000100:00100000:2.0:1788638545.121162:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183644800:0@lo:400:kworker.0 00000100:00100000:3.0:1788638545.125570:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638545.125577:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638545.125643:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183645056:0@lo:400:kworker.0 00000100:00100000:1.0:1788638545.125678:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638545.125749:0:11999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183645056 00000100:00100000:1.0:1788638545.125845:0:11999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183645056 00000100:00100000:1.0:1788638545.125901:0:11999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788638545.125910:0:11999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3291:x1875523183645056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638545.125978:0:11999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3291:x1875523183645056:12345-0@lo:400:kworker.0 Request processed in 69us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638545.125984:0:11999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788638545.126006:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183644544 00000100:00100000:1.0:1788638545.126009:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183644544 00000100:00100000:1.0:1788638545.126032:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788638545.126038:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3291:x1875523183644544:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788638545.126074:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788638545.126074:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383687450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3291:x1875523183644544:12345-0@lo:400:kworker.0 Request processed in 36us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638545.126084:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788638545.126089:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183644928 00000100:00100000:3.0:1788638545.126095:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183644928 00000100:00080000:3.0:1788638545.126112:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638545.126140:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788638545.126148:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183644928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638545.126186:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4893b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183644928:12345-0@lo:400:kworker.0 Request processed in 39us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638545.126193:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788638545.126231:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4893100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183644928:0@lo:400:kworker.0 00000100:00100000:3.0:1788638545.126410:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183644544:0@lo:400:kworker.0 00000100:00100000:3.0:1788638545.126424:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4893480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183645056:0@lo:400:kworker.0 00000100:00100000:2.0:1788638545.127136:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638545.127276:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638545.128193:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183644800 00000100:00100000:2.0:1788638545.128204:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183644800 00000100:00100000:2.0:1788638545.128278:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183644672 00000100:00100000:2.0:1788638545.128281:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183644672 00000100:00100000:2.0:1788638545.128302:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788638545.128324:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183644800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638545.128393:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183644800:12345-0@lo:400:kworker.0 Request processed in 83us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638545.128400:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788638545.128417:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788638545.128423:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183644672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638545.128449:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183644672:12345-0@lo:400:kworker.0 Request processed in 27us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638545.128454:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788638545.128488:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4891500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183644800:0@lo:400:kworker.0 00000100:00080000:0.0:1788638545.130332:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638545.130387:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4892d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183644672:0@lo:400:kworker.0 00000100:00100000:0.0:1788638545.201381:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638545.201462:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174189568 00000100:00100000:2.0:1788638545.201480:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174189568 00000100:00100000:2.0:1788638545.201539:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 102 00000100:00100000:2.0:1788638545.201549:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+47:10547:x1875523174189568:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:2.0:1788638545.201571:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638545.201604:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2af83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434f50 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.201698:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2af8a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.201737:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2af8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.202607:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2af8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.202626:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2af91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.202635:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2af91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.202641:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2af91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.204067:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2af98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.204084:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2af98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.204094:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2af98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638545.204105:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788638545.204214:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2af8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.204222:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2af8a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.204228:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2af8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.204247:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638545.204252:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2af8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.204260:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2af8a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.204273:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:2.0:1788638545.204276:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638545.204281:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2af8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.204287:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2af8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.204301:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2af91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.204306:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2af91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.204323:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2af91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.204328:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638545.204331:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2af91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.204337:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2af91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.204357:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c738a6e9e00) 00010000:00010000:2.0:1788638545.204359:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638545.204363:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2af91 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.204368:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2af91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.204413:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2af83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f50 expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.204426:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2af98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f50 expref: 49 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.204433:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:2.0:1788638545.204435:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788638545.204438:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6c00, rc 0) 00000100:00100000:2.0:1788638545.205942:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+49:10547:x1875523174189568:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 4385us (4563us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788638545.205954:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 102 00000100:00100000:3.0:1788638545.216418:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638545.216511:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174189696 00000100:00100000:2.0:1788638545.216521:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174189696 00000100:00100000:2.0:1788638545.216594:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 103 00000100:00100000:2.0:1788638545.216603:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+49:10547:x1875523174189696:12345-192.168.203.34@tcp:54:lfs.0 00010000:00010000:2.0:1788638545.216686:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2afa6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.216704:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2afa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.216744:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2afa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.216777:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2afa6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.216812:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2afa6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.216820:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2afa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.216826:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638545.216830:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2afa6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.216839:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2afa6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.216850:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:2.0:1788638545.216853:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788638545.216858:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2afa6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.216865:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2afa6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638545.216928:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4893480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+49:10547:x1875523174189696:12345-192.168.203.34@tcp:54:lfs.0 Request processed in 325us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638545.216936:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 103 00000100:00100000:3.0:1788638545.224767:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638545.225232:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174189952 00000100:00100000:1.0:1788638545.225242:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174189952 00000100:00100000:1.0:1788638545.225297:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 28 00000100:00100000:1.0:1788638545.225307:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+49:10547:x1875523174189952:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:1.0:1788638545.225565:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+50:10547:x1875523174189952:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 254us (803us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788638545.225573:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 28 00000100:00100000:2.0:1788638545.321606:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638545.321807:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174190208 00000100:00100000:1.0:1788638545.321817:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174190208 00000100:00100000:1.0:1788638545.321895:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 104 00000100:00100000:1.0:1788638545.321904:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+50:10557:x1875523174190208:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:1.0:1788638545.321994:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638545.321998:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788638545.322027:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2af28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f34 expref: 50 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.322047:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:1.0:1788638545.322052:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788638545.322064:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2afad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434f57 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.322155:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2afb4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.322168:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2af98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f50 expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.322178:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2afb4 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.322213:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2af98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f50 expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.322227:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2af98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f50 expref: 50 pid: 5844 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638545.322242:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875523183645184:192.168.203.34@tcp:104: 00000100:00100000:1.0:1788638545.322400:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387969d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788638545.329206:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638545.329939:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174190336 00000100:00100000:2.0:1788638545.329952:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174190336 00010000:00010000:2.0:1788638545.329996:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2af98 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f50 expref: 51 pid: 5844 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638545.330046:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 52 00000100:00100000:2.0:1788638545.330056:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4893100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+51:2364:x1875523174190336:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638545.330072:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638545.330080:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2af98 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f50 expref: 51 pid: 5844 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.330095:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2af98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f50 expref: 51 pid: 5844 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.330118:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:2.0:1788638545.330123:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2afb4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.330133:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2afb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.330141:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2afb4 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.330162:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638545.330218:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4893100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+51:2364:x1875523174190336:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 164us (1022us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638545.330225:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 52 00010000:00010000:1.0:1788638545.334099:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2af98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f50 expref: 50 pid: 5844 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638545.334127:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875523183645184:192.168.203.34@tcp:104: 00010000:00010000:1.0:1788638545.334151:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2afb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.334162:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2afb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.334168:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2afb4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788638545.334189:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788638545.334357:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2afad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f57 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.334374:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2afb4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f57 expref: 50 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.334383:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:1.0:1788638545.334386:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788638545.334390:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309600, rc 0) 00000100:00100000:1.0:1788638545.335685:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+50:10557:x1875523174190208:12345-192.168.203.34@tcp:101:bash.0 Request processed in 13775us (14082us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788638545.335696:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 104 00000100:00100000:3.0:1788638545.353038:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638545.353526:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174190592 00000100:00100000:2.0:1788638545.353564:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174190592 00000100:00100000:2.0:1788638545.353648:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 105 00000100:00100000:2.0:1788638545.353661:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+50:10557:x1875523174190592:12345-192.168.203.34@tcp:36:bash.0 00010000:00010000:2.0:1788638545.354064:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2afc2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.354086:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2afc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.354102:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2afc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788638545.354179:0:7634:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788638545.354205:0:7634:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000293a5648 reply state 00000000285912a3 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2afc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638545.354216:0:7634:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788638545.354350:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4890000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+53:10557:x1875523174190592:12345-192.168.203.34@tcp:36:bash.0 Request processed in 690us (2485us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788638545.354359:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 105 00000020:00080000:2.0:1788638545.354365:0:7634:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788638545.363440:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2afc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.363458:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2afc2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.363474:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2afc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.363480:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638545.363485:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2afc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.363510:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2afc2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.363526:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:0.0:1788638545.363529:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638545.363534:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2afc2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.363541:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2afc2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638545.372441:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638545.377481:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174190720 00000100:00100000:0.0:1788638545.377498:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174190720 00000100:00100000:1.0:1788638545.380625:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 106 00000100:00100000:1.0:1788638545.380656:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+52:10557:x1875523174190720:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:1.0:1788638545.380684:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638545.380707:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2afc9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434f5e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.381224:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2afd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.381240:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2afb4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f57 expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.381250:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2afd0 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.381284:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2afb4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f57 expref: 53 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.381299:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2afb4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f57 expref: 53 pid: 5842 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638545.381324:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875523183645312:192.168.203.34@tcp:104: 00000100:00100000:1.0:1788638545.381431:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738563db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788638545.388595:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638545.389573:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875523183645312:192.168.203.34@tcp:104: 00010000:00010000:1.0:1788638545.389609:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2afd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638545.390123:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174190848 00000100:00100000:2.0:1788638545.390139:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174190848 00010000:00010000:2.0:1788638545.390246:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2afb4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f57 expref: 54 pid: 5842 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638545.390287:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 53 00000100:00100000:2.0:1788638545.390296:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4891180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+54:2364:x1875523174190848:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638545.390318:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638545.390337:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2afb4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f57 expref: 54 pid: 5842 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.390350:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2afb4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f57 expref: 54 pid: 5842 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.390372:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2afb4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f57 expref: 54 pid: 5842 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.390388:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:2.0:1788638545.390393:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2afd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.390403:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2afd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.390411:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2afd0 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.390441:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638545.390494:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4891180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+53:2364:x1875523174190848:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 199us (1913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638545.390501:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 53 00010000:00010000:3.0:1788638545.391009:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2afd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.391025:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2afd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638545.391958:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788638545.391966:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788638545.391993:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2afd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.392031:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2afc9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f5e expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.392069:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2afd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f5e expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.392078:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:2.0:1788638545.392081:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788638545.392084:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309c00, rc 0) 00000100:00100000:2.0:1788638545.392140:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+52:10557:x1875523174190720:12345-192.168.203.34@tcp:101:bash.0 Request processed in 11490us (19714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638545.392148:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 106 00000100:00100000:3.0:1788638545.403859:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638545.405057:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174191104 00000100:00100000:2.0:1788638545.405077:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174191104 00000100:00100000:2.0:1788638545.405179:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 29 00000100:00100000:2.0:1788638545.405203:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+52:10557:x1875523174191104:12345-192.168.203.34@tcp:35:bash.0 00000100:00100000:2.0:1788638545.407685:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+53:10557:x1875523174191104:12345-192.168.203.34@tcp:35:bash.0 Request processed in 2468us (3887us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1788638545.407703:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 29 00000100:00100000:3.0:1788638545.500462:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638545.500599:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174191232 00000100:00100000:0.0:1788638545.500612:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174191232 00000100:00100000:0.0:1788638545.500695:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 107 00000100:00100000:0.0:1788638545.500708:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+53:10563:x1875523174191232:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638545.500743:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638545.500770:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2afd7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434f65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.500907:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2afde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.500927:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2afde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.500940:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2afde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638545.501009:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788638545.501013:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638545.501041:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2afde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.501072:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2afd7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f65 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.501095:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2afde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f65 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.501105:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:0.0:1788638545.501108:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788638545.501112:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01da00, rc 0) 00000100:00100000:1.0:1788638545.501244:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4892d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+54:10563:x1875523174191232:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 535us (796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638545.501262:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 107 00000100:00100000:0.0:1788638545.506270:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638545.506473:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174191360 00000100:00100000:3.0:1788638545.506487:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174191360 00000100:00100000:3.0:1788638545.506565:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 108 00000100:00100000:3.0:1788638545.506577:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+54:10563:x1875523174191360:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:3.0:1788638545.506606:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638545.506634:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2afe5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434f6c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.506727:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2afec lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.506747:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2afec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.506761:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2afec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.506837:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2aff3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.506847:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2aff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.506855:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2aff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.506987:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2affa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.507017:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2affa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.507024:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2affa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638545.507082:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788638545.507088:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788638545.507112:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2affa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.507128:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2affa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.507139:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2afec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.507146:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2afec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.507155:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2afec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.507161:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638545.507167:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2afec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.507177:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2afec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.507193:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:3.0:1788638545.507196:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638545.507211:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2afec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.507219:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2afec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.507239:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2aff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.507245:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2aff3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.507251:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2aff3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.507256:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638545.507260:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2aff3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.507266:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2aff3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.507292:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c7393e81100) 00010000:00010000:3.0:1788638545.507295:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638545.507298:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2aff3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.507304:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2aff3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.507764:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2afe5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f6c expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.507872:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2affa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f6c expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.507891:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:3.0:1788638545.507894:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788638545.507897:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031400, rc 0) 00000100:00100000:2.0:1788638545.508401:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+55:10563:x1875523174191360:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 1817us (2138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638545.508414:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 108 00000100:00100000:3.0:1788638545.517135:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638545.517201:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638545.517540:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174191744 00000100:00100000:1.0:1788638545.517555:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174191744 00000100:00100000:1.0:1788638545.517636:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 7 00000100:00100000:1.0:1788638545.517647:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4890a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+55:2365:x1875523174191744:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638545.517669:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638545.517701:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2affa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f6c expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.517728:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:1.0:1788638545.517734:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638545.517855:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4890a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+54:2365:x1875523174191744:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 209us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638545.517864:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 7 00000100:00100000:2.0:1788638545.518147:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174191616 00000100:00100000:2.0:1788638545.518152:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174191616 00000100:00100000:2.0:1788638545.518199:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 109 00000100:00100000:2.0:1788638545.518208:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+54:10563:x1875523174191616:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:2.0:1788638545.518230:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638545.518281:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2b001 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434f73 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.518624:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b008 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.518644:0:7634:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2afd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f5e expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.518654:0:7634:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b008 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.518700:0:7634:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2afd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f5e expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.518716:0:7634:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2afd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f5e expref: 55 pid: 5844 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638545.518732:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bbb79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7634:1875523183645440:192.168.203.34@tcp:104: 00000100:00100000:2.0:1788638545.518866:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73c0a369c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638545.522737:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bbb79f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7634:1875523183645440:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638545.522811:0:7634:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b008 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638545.524702:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638545.525179:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174191872 00000100:00100000:2.0:1788638545.525191:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174191872 00010000:00010000:2.0:1788638545.525242:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2afd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f5e expref: 56 pid: 5844 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638545.525335:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 54 00000100:00100000:2.0:1788638545.525347:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384df8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+56:2365:x1875523174191872:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638545.525373:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638545.525382:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2afd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f5e expref: 56 pid: 5844 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.525399:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2afd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f5e expref: 56 pid: 5844 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.525604:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2afd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f5e expref: 56 pid: 5844 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.525625:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:2.0:1788638545.525631:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b008 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.525642:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b008 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.525651:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b008 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.525685:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638545.525753:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384df8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+55:2365:x1875523174191872:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 409us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638545.525761:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 54 00010000:00010000:3.0:1788638545.526370:0:7634:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b008 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.526383:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b008 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638545.526410:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788638545.526636:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2b001 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f73 expref: 56 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.526657:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b008 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f73 expref: 55 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.526667:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:3.0:1788638545.526670:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788638545.526672:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6e00, rc 0) 00000100:00100000:3.0:1788638545.526734:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4891500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+55:10563:x1875523174191616:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 8527us (9620us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788638545.526761:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 109 00000100:00100000:3.0:1788638545.531515:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638545.531632:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174192128 00000100:00100000:1.0:1788638545.531645:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174192128 00000100:00100000:1.0:1788638545.531732:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:1.0:1788638545.531745:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4892300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+55:10563:x1875523174192128:12345-192.168.203.34@tcp:103:lfs.0 00010000:00010000:1.0:1788638545.531767:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638545.531830:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2af67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f49 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.531855:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:1.0:1788638545.531863:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638545.531956:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4892300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+54:10563:x1875523174192128:12345-192.168.203.34@tcp:103:lfs.0 Request processed in 214us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638545.531991:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:2.0:1788638545.534910:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638545.535053:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174192256 00000100:00100000:1.0:1788638545.535066:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174192256 00000100:00100000:1.0:1788638545.535137:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 110 00000100:00100000:1.0:1788638545.535149:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+54:10563:x1875523174192256:12345-192.168.203.34@tcp:58:lfs.0 00010000:00010000:1.0:1788638545.535330:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2b016 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.535361:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2b016 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.535378:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2b016 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788638545.535634:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788638545.535738:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+54:10563:x1875523174192256:12345-192.168.203.34@tcp:58:lfs.0 Request processed in 589us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638545.535747:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 110 00000100:00100000:3.0:1788638545.539261:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638545.542979:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174192384 00000100:00100000:0.0:1788638545.543005:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174192384 00000100:00100000:0.0:1788638545.543157:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 111 00000100:00100000:0.0:1788638545.543170:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+54:10563:x1875523174192384:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638545.543197:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638545.543227:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2b01d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434f7a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.543329:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2b016 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.543343:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2b01d lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f7a expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.543396:0:5843:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2b016 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.543412:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2b01d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f7a expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.543428:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:0.0:1788638545.543432:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788638545.543436:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2b01d lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f7a expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.543445:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01d800, rc 0) 00000100:00100000:0.0:1788638545.543523:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4890700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+55:10563:x1875523174192384:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 356us (4278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638545.543531:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 111 00000040:00080000:2.0:1788638545.568227:0:11706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788638545.568241:0:11706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788638545.568509:0:11706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788638545.568517:0:11706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788638545.568690:0:11706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bbb7ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11706:1875523183645568:192.168.203.34@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788638545.568856:0:11706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398581c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788638545.574163:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638545.574371:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174192512 00000100:00100000:1.0:1788638545.574385:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174192512 00000100:00100000:1.0:1788638545.574470:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 112 00000100:00100000:1.0:1788638545.574482:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+56:10564:x1875523174192512:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788638545.574529:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788638545.574715:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4893800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+56:10564:x1875523174192512:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 Request processed in 234us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638545.574724:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 112 00000100:00100000:2.0:1788638545.575096:0:11706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bbb7ad80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11706:1875523183645568:192.168.203.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788638545.580086:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638545.580272:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174192640 00000100:00100000:2.0:1788638545.580286:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174192640 00000100:00100000:2.0:1788638545.580390:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 113 00000100:00100000:2.0:1788638545.580401:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+55:10564:x1875523174192640:12345-192.168.203.34@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788638545.580502:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b024 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.580525:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b024 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.580540:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b024 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.580558:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b02b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.580566:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b02b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.580573:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b02b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.580599:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b032 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.580627:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b032 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.580635:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b032 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638545.580685:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788638545.580690:0:7634:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788638545.580707:0:7634:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b032 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.580720:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b024 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.580727:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b024 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.580734:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b024 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.580741:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638545.580746:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b024 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.580754:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b024 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.580768:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c73a1cf7600) 00010000:00010000:2.0:1788638545.580772:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638545.580778:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b024 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.580854:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b024 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.580871:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b02b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.580877:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b02b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.581074:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b02b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.581080:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638545.581083:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b02b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.581090:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b02b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.581100:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9c738a6e9e00) 00010000:00010000:2.0:1788638545.581103:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638545.581107:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b02b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.581112:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b02b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.581131:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b032 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.581137:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b032 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.581151:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b032 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.581156:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638545.581159:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b032 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.581165:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b032 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.581174:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:2.0:1788638545.581177:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638545.581180:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b032 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.581187:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b032 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638545.581299:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4891c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+55:10564:x1875523174192640:12345-192.168.203.34@tcp:34:lhsmtool_posix.0 Request processed in 898us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638545.581320:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 113 00000100:00100000:0.0:1788638545.586920:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638545.587009:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174192896 00000100:00100000:1.0:1788638545.587041:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174192896 00000100:00100000:1.0:1788638545.587120:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 114 00000100:00100000:1.0:1788638545.587133:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+55:10564:x1875523174192896:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788638545.587165:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638545.587193:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b039 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434f81 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.587372:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b040 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.587393:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b040 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.587408:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b040 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788638545.587431:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788638545.587567:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b040 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.587577:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b040 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.587584:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b040 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.587591:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638545.587596:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b040 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.587604:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b040 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.587626:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:1.0:1788638545.587629:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788638545.587635:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b040 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.587641:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b040 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.587694:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b039 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f81 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.587706:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c73a1cf7600) 00010000:00010000:1.0:1788638545.587708:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788638545.587712:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b039 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f81 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.587722:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309c00, rc 0) 00000100:00100000:1.0:1788638545.587867:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+56:10564:x1875523174192896:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 737us (961us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1788638545.587875:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 114 00000100:00100000:3.0:1788638545.591611:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638545.591770:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174193024 00000100:00100000:2.0:1788638545.591824:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174193024 00000100:00100000:2.0:1788638545.591906:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 115 00000100:00100000:2.0:1788638545.591918:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+56:10564:x1875523174193024:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788638545.591968:0:7634:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788638545.592116:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4893100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+56:10564:x1875523174193024:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 Request processed in 199us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638545.592146:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 115 00000100:00100000:2.0:1788638545.595981:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638545.596335:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174193280 00000100:00100000:1.0:1788638545.596349:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174193280 00000100:00100000:1.0:1788638545.596443:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 116 00000100:00100000:1.0:1788638545.596454:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+56:10564:x1875523174193280:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788638545.596481:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638545.596486:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788638545.596520:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2afde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f65 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.596564:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:1.0:1788638545.596571:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788638545.596590:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b04e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434f88 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788638545.597177:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788638545.601471:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b055 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.601495:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b055 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.601506:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b055 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.601614:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b04e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f88 expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.601636:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b055 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f88 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.601644:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c7398420e00) 00010000:00010000:1.0:1788638545.601647:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788638545.601650:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309600, rc 0) 00000100:00100000:1.0:1788638545.601720:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+57:10564:x1875523174193280:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 5267us (5753us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788638545.601728:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 116 00000100:00100000:3.0:1788638545.605229:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638545.610138:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174193536 00000100:00100000:2.0:1788638545.610160:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174193536 00000100:00100000:2.0:1788638545.610337:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 117 00000100:00100000:2.0:1788638545.610352:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+57:10564:x1875523174193536:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788638545.610444:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638545.610480:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b055 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f88 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.610507:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c7398420e00) 00010000:00010000:2.0:1788638545.610522:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788638545.610552:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b063 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.610570:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b063 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.610581:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b063 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.612757:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b06a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x4a88b7ab bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.612867:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b06a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4a88b7ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.612882:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b06a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4a88b7ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.613031:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b063 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.613039:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b063 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.613046:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b063 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.613052:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638545.613056:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b063 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.613064:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b063 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.613077:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:2.0:1788638545.613080:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638545.613084:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b063 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.613090:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b063 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.613102:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b06a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4a88b7ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.613108:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b06a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4a88b7ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.613113:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b06a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4a88b7ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.613128:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638545.613131:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b06a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4a88b7ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.613137:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b06a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4a88b7ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.613146:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x4a88b7ab (ffff9c738a6e9e00) 00010000:00010000:2.0:1788638545.613149:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638545.613151:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b06a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4a88b7ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.613158:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b06a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4a88b7ab bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638545.613261:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4891180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+56:10564:x1875523174193536:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 Request processed in 2909us (8046us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788638545.613271:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 117 00000100:00100000:3.0:1788638545.619093:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638545.619470:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174193664 00000100:00100000:2.0:1788638545.619486:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174193664 00000100:00100000:2.0:1788638545.619561:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 118 00000100:00100000:2.0:1788638545.619571:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+56:10564:x1875523174193664:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788638545.619592:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638545.619627:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b071 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434f8f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.619664:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b078 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.619700:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.619713:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b078 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.619859:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b071 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f8f expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.619882:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b078 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f8f expref: 57 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.619891:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c738a6e9700) 00010000:00010000:2.0:1788638545.619895:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788638545.619899:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6a00, rc 0) 00000100:00100000:2.0:1788638545.619981:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4890a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+57:10564:x1875523174193664:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 411us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638545.619988:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 118 00000100:00100000:3.0:1788638545.623215:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638545.623485:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174193920 00000100:00100000:0.0:1788638545.623498:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174193920 00000100:00100000:0.0:1788638545.623577:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 119 00000100:00100000:0.0:1788638545.623588:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+57:10564:x1875523174193920:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788638545.623698:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b07f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.623720:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b07f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.623733:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b07f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788638545.624109:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1788638545.624122:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 308695338158ns, next at 309695334759ns, rc = 0 00000004:00010000:0.0:1788638545.624226:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a125606e reply state 000000007d63c03e transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b07f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638545.624237:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788638545.625043:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+59:10564:x1875523174193920:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 Request processed in 1449us (1835us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1788638545.625054:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 119 00000100:00100000:1.0:1788638545.632198:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788638545.632222:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183645696:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788638545.632299:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638545.632381:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183645696 00000100:00100000:1.0:1788638545.632388:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183645696 00000100:00100000:1.0:1788638545.632439:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788638545.632450:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1875523183645696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788638545.632488:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788638545.632547:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1875523183645696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638545.632555:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788638545.632619:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183645696:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788638545.635600:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00010000:00010000:2.0:1788638545.636168:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b07f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.636186:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b07f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.636194:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b07f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.636200:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638545.636206:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b07f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.636230:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b07f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.636253:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c738a6e9700) 00010000:00010000:2.0:1788638545.636256:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788638545.636262:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b07f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.636269:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b07f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638545.636335:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174194048 00000100:00100000:2.0:1788638545.636348:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174194048 00000100:00100000:2.0:1788638545.636433:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 120 00000100:00100000:2.0:1788638545.636444:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+58:10564:x1875523174194048:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788638545.636473:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638545.636493:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b086 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434f96 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.636568:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b086 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f96 expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.636584:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b086 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f96 expref: 59 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.636605:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c738a6e9700) 00010000:00010000:2.0:1788638545.636608:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788638545.636611:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6c00, rc 0) 00000100:00100000:2.0:1788638545.636707:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+59:10564:x1875523174194048:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 264us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638545.636715:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 120 00000100:00100000:0.0:1788638545.642214:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638545.642467:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174194176 00000100:00100000:1.0:1788638545.642481:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174194176 00000100:00080000:0.0:1788638545.642546:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788638545.642586:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 37 00000100:00100000:1.0:1788638545.642597:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2364:x1875523174194176:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788638545.643003:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c29500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+9:2364:x1875523174194176:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 Request processed in 404us (799us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788638545.651085:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638545.651218:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 37 00000100:00100000:3.0:1788638545.651274:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174194432 00000100:00100000:3.0:1788638545.651289:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174194432 00000100:00100000:3.0:1788638545.651557:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 30 00000100:00100000:3.0:1788638545.651570:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+59:10564:x1875523174194432:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788638545.651959:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+60:10564:x1875523174194432:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 Request processed in 388us (880us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1788638545.651970:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 30 00000100:00100000:0.0:1788638545.655751:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638545.655974:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174194688 00000100:00100000:2.0:1788638545.655989:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174194688 00000100:00100000:2.0:1788638545.656079:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 121 00000100:00100000:2.0:1788638545.656095:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+60:10564:x1875523174194688:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788638545.656317:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bfbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+60:10564:x1875523174194688:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 Request processed in 217us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638545.656621:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 121 00000100:00100000:1.0:1788638545.662811:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638545.663588:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174194816 00000100:00100000:0.0:1788638545.663604:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174194816 00000100:00100000:0.0:1788638545.663675:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 122 00000100:00100000:0.0:1788638545.663691:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+60:10564:x1875523174194816:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788638545.663719:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638545.663748:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b08d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434f9d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.663867:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b094 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.663896:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b094 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.663931:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b094 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638545.663990:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638545.664012:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b094 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.664041:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b08d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f9d expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.664061:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b094 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f9d expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.664071:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c738a6e9700) 00010000:00010000:0.0:1788638545.664074:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788638545.664078:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01d200, rc 0) 00000100:00100000:0.0:1788638545.664150:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+61:10564:x1875523174194816:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 462us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638545.664157:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 122 00000100:00100000:2.0:1788638545.667611:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638545.667928:0:11999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174194944 00000100:00100000:2.0:1788638545.667943:0:11999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174194944 00000100:00100000:2.0:1788638545.668017:0:11999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 38 00000100:00100000:2.0:1788638545.668031:0:11999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+9:2365:x1875523174194944:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788638545.668056:0:11999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638545.668104:0:11999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000560ce6db/0xa0b1f1e3b4b2b09b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434fa4 expref: -99 pid: 11999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788638545.668144:0:11999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c7551, blocks: 0x1 00010000:00010000:2.0:1788638545.668170:0:11999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=308s v=(0 0) 00010000:00010000:2.0:1788638545.668176:0:11999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788638545.668188:0:11999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000560ce6db/0xa0b1f1e3b4b2b09b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fa4 expref: 10 pid: 11999 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.668216:0:11999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000560ce6db/0xa0b1f1e3b4b2b09b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fa4 expref: 10 pid: 11999 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.668490:0:11999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7400, rc 0) 00000100:00100000:2.0:1788638545.668625:0:11999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+10:2365:x1875523174194944:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 596us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638545.668634:0:11999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 38 00000100:00100000:0.0:1788638545.673210:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638545.673268:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174195200 00000100:00100000:2.0:1788638545.673282:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174195200 00000100:00100000:2.0:1788638545.673365:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 123 00000100:00100000:2.0:1788638545.673450:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+61:10564:x1875523174195200:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788638545.673595:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+61:10564:x1875523174195200:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 Request processed in 151us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638545.673604:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 123 00000100:00100000:1.0:1788638545.677237:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638545.677519:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174195328 00000100:00100000:3.0:1788638545.677532:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174195328 00000100:00100000:3.0:1788638545.677637:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 39 00000100:00100000:3.0:1788638545.677649:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+10:10564:x1875523174195328:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788638545.677671:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638545.677698:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b718493/0xa0b1f1e3b4b2b0a2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434fab expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.677737:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000560ce6db/0xa0b1f1e3b4b2b09b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fa4 expref: 11 pid: 11999 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.677763:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788638545.677768:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788638545.677775:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b718493/0xa0b1f1e3b4b2b0a2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fab expref: 11 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.677854:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000560ce6db/0xa0b1f1e3b4b2b09b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fa4 expref: 11 pid: 11999 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.677871:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000560ce6db/0xa0b1f1e3b4b2b09b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fa4 expref: 11 pid: 11999 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638545.677900:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387dbd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1875523183645824:192.168.203.34@tcp:104: 00000100:00100000:3.0:1788638545.678021:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7385610a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788638545.680167:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387dbd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1875523183645824:192.168.203.34@tcp:104: 00010000:00010000:3.0:1788638545.680213:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001b718493/0xa0b1f1e3b4b2b0a2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fab expref: 11 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.680240:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030c00, rc 0) 00000100:00100000:3.0:1788638545.680319:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+11:10564:x1875523174195328:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 2673us (3097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638545.680337:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 39 00000100:00100000:2.0:1788638545.682890:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638545.682927:0:11689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174195456 00000100:00100000:1.0:1788638545.682941:0:11689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174195456 00010000:00010000:1.0:1788638545.682991:0:11689:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000560ce6db/0xa0b1f1e3b4b2b09b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fa4 expref: 11 pid: 11999 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638545.683036:0:11689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 55 00000100:00100000:1.0:1788638545.683053:0:11689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4899880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+11:2364:x1875523174195456:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638545.683071:0:11689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638545.683100:0:11689:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000560ce6db/0xa0b1f1e3b4b2b09b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fa4 expref: 11 pid: 11999 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.683116:0:11689:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000560ce6db/0xa0b1f1e3b4b2b09b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fa4 expref: 11 pid: 11999 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.683144:0:11689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000560ce6db/0xa0b1f1e3b4b2b09b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fa4 expref: 11 pid: 11999 timeout: 408 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.683164:0:11689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638545.683168:0:11689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638545.683178:0:11689:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001b718493/0xa0b1f1e3b4b2b0a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fab expref: 10 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.683189:0:11689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b718493/0xa0b1f1e3b4b2b0a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fab expref: 10 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.683237:0:11689:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000001b718493/0xa0b1f1e3b4b2b0a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fab expref: 10 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638545.683254:0:11689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7398c2ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11689:1875523183645952:192.168.203.34@tcp:105: 00000100:00100000:1.0:1788638545.683548:0:11689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788638545.688636:0:11689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7398c2ea00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11689:1875523183645952:192.168.203.34@tcp:105: 00010000:00010000:3.0:1788638545.688672:0:11689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638545.688772:0:11689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4899880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+10:2364:x1875523174195456:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 5718us (5896us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638545.688825:0:11689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 55 00000100:00100000:1.0:1788638545.692549:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638545.693634:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174195584 00000100:00100000:0.0:1788638545.693651:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174195584 00002000:00100000:0.0:1788638545.693720:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9c7398c2ea00 x1875523174195584/t0(0) o4->00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp:521/0 lens 504/0 e 0 to 0 dl 1788638556 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788638545.693732:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7398c2ea00 with x1875523174195584 ext(0->12) 00002000:00010000:0.0:1788638545.693739:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c7398c2ea00 00000100:00100000:0.0:1788638545.693821:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 2 00000100:00100000:0.0:1788638545.693840:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+10:2364:x1875523174195584:12345-192.168.203.34@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788638545.694923:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+12:2364:x1875523174195584:12345-192.168.203.34@tcp:4:lhsmtool_posix.0 Request processed in 1077us (2382us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788638545.694937:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 2 00002000:00100000:0.0:1788638545.694947:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9c7398c2ea00 x1875523174195584/t4294967308(0) o4->00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp:521/0 lens 504/448 e 0 to 0 dl 1788638556 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788638545.694958:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7398c2ea00 with x1875523174195584 ext(0->12) 00002000:00010000:0.0:1788638545.694964:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c7398c2ea00 00000100:00100000:3.0:1788638545.698648:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638545.698697:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174195712 00000100:00100000:0.0:1788638545.698710:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174195712 00000100:00100000:0.0:1788638545.698802:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 124 00000100:00100000:0.0:1788638545.698815:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+61:10564:x1875523174195712:12345-192.168.203.34@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788638545.712294:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1788638545.712328:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:0.0:1788638545.769202:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:0.0:1788638545.769223:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1788638545.769256:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:2.0:1788638545.769865:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183646080:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788638545.769979:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638545.770222:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183646080 00000100:00100000:1.0:1788638545.770232:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183646080 00000100:00100000:1.0:1788638545.770314:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788638545.770341:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b489ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3293:x1875523183646080:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788638545.770378:0:6684:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1788638545.770411:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2b0a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.770440:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000610063e8/0xa0b1f1e3b4b2ae6b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f0a expref: 11 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.770449:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788638545.770454:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788638545.770459:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2b0a9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.770494:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000610063e8/0xa0b1f1e3b4b2ae6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f0a expref: 11 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.770511:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000610063e8/0xa0b1f1e3b4b2ae6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f0a expref: 11 pid: 6684 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638545.770524:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7da1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6684:1875523183646336:192.168.203.34@tcp:104: 00000100:00100000:1.0:1788638545.770599:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304a240 going to sleep for 11 seconds 00000100:00100000:2.0:1788638545.774502:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788638545.774533:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183646208:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788638545.774633:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1788638545.775100:0:11987:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:0.0:1788638545.775125:0:11987:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c73866b19c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:0.0:1788638545.775130:0:11987:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7386690b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c7384e6be40 00000020:00080000:0.0:1788638545.775133:0:11987:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7386690c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c73b4acf800 00000001:00080000:0.0:1788638545.775168:0:11987:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:0.0:1788638545.775187:0:11987:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c73bf299d80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:0.0:1788638545.775191:0:11987:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7387978400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c73bf299a80 00000020:00080000:0.0:1788638545.775194:0:11987:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7387978600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c73bf629c00 00000020:00080000:0.0:1788638545.775567:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:0.0:1788638545.776211:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1788638545.776237:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183646464:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788638545.776699:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638545.777692:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7da1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6684:1875523183646336:192.168.203.34@tcp:104: 00010000:00010000:3.0:1788638545.777730:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2b0a9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638545.778404:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+15:10564:x1875523174195712:12345-192.168.203.34@tcp:44:lhsmtool_posix.0 Request processed in 79587us (79765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638545.778418:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 124 00000100:00100000:1.0:1788638545.780088:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183646208 00000100:00100000:1.0:1788638545.780133:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183646208 00000100:00100000:1.0:1788638545.780207:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183646464 00000100:00100000:1.0:1788638545.780213:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183646464 00000100:00100000:1.0:1788638545.780253:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788638545.780264:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3293:x1875523183646208:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788638545.780720:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788638545.780725:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788638545 00002000:00010000:1.0:1788638545.780728:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788638545.780730:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788638545 -> 1788638545 00002000:00010000:1.0:1788638545.780732:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788638545.780978:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4899500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3293:x1875523183646208:12345-0@lo:2:osp-syn-1-0.0 Request processed in 715us (6344us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788638545.780989:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788638545.781020:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788638545.781030:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183646464:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788638545.781056:0:6686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1788638545.781093:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c7550, atime: 0x6a9c7551, ctime: 0x6a9c7550, blocks: 0xb 00010000:00010000:1.0:1788638545.781102:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b0b0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.781121:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=308s v=(0 0) 00010000:00010000:1.0:1788638545.781127:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00000004:00080000:2.0:1788638545.781406:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c73837a7b80/2, rc 0, transno 4294967309 00000100:00100000:2.0:1788638545.781416:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183646208:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788638545.781563:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b0b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.781583:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b0b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.781617:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b0b0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.781627:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b0b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.781658:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788638545.782615:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00080000:0.0:1788638545.782659:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788638545.782684:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174195840 00000100:00100000:0.0:1788638545.782695:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174195840 00010000:00010000:0.0:1788638545.782744:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000610063e8/0xa0b1f1e3b4b2ae6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f0a expref: 12 pid: 6684 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638545.782866:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 56 00000100:00100000:0.0:1788638545.782878:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+12:2365:x1875523174195840:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788638545.782895:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638545.782901:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000610063e8/0xa0b1f1e3b4b2ae6b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f0a expref: 12 pid: 6684 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.782916:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000610063e8/0xa0b1f1e3b4b2ae6b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f0a expref: 12 pid: 6684 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.782942:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000610063e8/0xa0b1f1e3b4b2ae6b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f0a expref: 12 pid: 6684 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.782963:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788638545.782967:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788638545.782974:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2b0a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.783001:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2b0a9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.783037:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638545.783099:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+11:2365:x1875523174195840:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 224us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638545.783107:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 56 00010000:00010000:2.0:1788638545.783489:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638545.783507:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b0b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.783516:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309800 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638545.783522:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b0b0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.783533:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b0b0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.783548:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b0b0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.783555:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b0b0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.783580:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638545.783581:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638545.783583:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638545.784251:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3291:x1875523183646464:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3218us (7547us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788638545.784264:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:0.0:1788638545.784492:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2b0a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.784504:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2b0a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.784515:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2b0a9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.784523:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2b0a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.784549:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788638545.785173:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b489ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3293:x1875523183646080:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14831us (15191us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788638545.785184:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000004:00080000:0.0:1788638545.785258:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c73837a4700/2, rc 0, transno 4294967310 00000100:00100000:0.0:1788638545.785266:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183646080:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788638545.785401:0:3291:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1788638545.785409:0:3291:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:2.0:1788638545.785435:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c73b7da1c00, transno 4294967301 00000004:00080000:2.0:1788638545.785452:0:3291:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:2.0:1788638545.785468:0:3291:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c73837a5500 x1875523183646464/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788638561 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788638545.785478:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c73837a5500/2, rc 0, transno 4294967304 00000100:00100000:2.0:1788638545.785483:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183646464:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1788638545.785997:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638545.786008:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2b0a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.786020:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638545.786025:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2b0a9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.786037:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2b0a9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.786062:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2b0a9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.786070:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2b0a9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.786101:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638545.786104:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638545.786106:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638545.789522:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638545.789677:0:11999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174195968 00000100:00100000:2.0:1788638545.789690:0:11999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174195968 00000100:00100000:2.0:1788638545.789882:0:11999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 43 00000100:00100000:2.0:1788638545.789895:0:11999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+11:2365:x1875523174195968:12345-192.168.203.34@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1788638545.824482:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788638545.865822:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:0.0:1788638545.865845:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1788638545.866154:0:11999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2365:x1875523174195968:12345-192.168.203.34@tcp:16:lhsmtool_posix.0 Request processed in 76253us (79564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638545.866169:0:11999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 43 00000100:00100000:0.0:1788638545.869778:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638545.870133:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174196224 00000100:00100000:2.0:1788638545.870147:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174196224 00000100:00100000:2.0:1788638545.870219:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 125 00000100:00100000:2.0:1788638545.870231:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+15:10564:x1875523174196224:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788638545.870550:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638545.870588:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b094 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f9d expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.870613:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c738a6e9700) 00010000:00010000:2.0:1788638545.870619:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788638545.870660:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b0b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.870679:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b0b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.870691:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b0b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788638545.871462:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000073f75be1 reply state 000000003d3ae5f5 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b0b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638545.871479:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788638545.872109:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f24000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+16:10564:x1875523174196224:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 Request processed in 1873us (2340us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1788638545.872143:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 125 00010000:00010000:3.0:1788638545.874670:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b0b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.874690:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b0b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.874698:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b0b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.874704:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638545.874711:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b0b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.874719:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b0b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.874741:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c738a6e9700) 00010000:00010000:3.0:1788638545.874744:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638545.874749:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b0b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.874756:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b0b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638545.885662:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638545.885897:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174196352 00000100:00100000:0.0:1788638545.885911:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174196352 00000100:00100000:0.0:1788638545.886002:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 44 00000100:00100000:0.0:1788638545.886014:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174196352:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788638545.886539:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1788638545.886544:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788638545 -> 1788638545 00002000:00010000:0.0:1788638545.886546:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788638545 00002000:00010000:0.0:1788638545.886549:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788638545 -> 1788638545 00002000:00010000:0.0:1788638545.886551:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788638545.886652:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2364:x1875523174196352:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 Request processed in 638us (1002us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788638545.886661:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 44 00000100:00100000:1.0:1788638545.897367:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638545.897547:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174196608 00000100:00100000:0.0:1788638545.897561:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174196608 00000100:00100000:0.0:1788638545.897693:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 126 00000100:00100000:0.0:1788638545.897706:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+15:10564:x1875523174196608:12345-192.168.203.34@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788638545.897825:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b0be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.897848:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b078 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f8f expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.897859:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b0be lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.897939:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b078 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f8f expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.897956:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b078 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f8f expref: 15 pid: 5842 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638545.897987:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f24380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875523183646592:192.168.203.34@tcp:104: 00000100:00100000:0.0:1788638545.898210:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73984fd840 going to sleep for 11 seconds 00000100:00100000:1.0:1788638545.902944:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638545.903039:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174196736 00000100:00100000:3.0:1788638545.903050:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174196736 00010000:00010000:3.0:1788638545.903101:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b078 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f8f expref: 16 pid: 5842 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638545.903150:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 57 00000100:00100000:3.0:1788638545.903162:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+16:2364:x1875523174196736:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788638545.903180:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638545.903188:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b078 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f8f expref: 16 pid: 5842 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.903202:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b078 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f8f expref: 16 pid: 5842 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.903230:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c738a6e9700) 00010000:00010000:3.0:1788638545.903236:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b0be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.903247:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b0be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.903256:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b0be lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.903285:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638545.903356:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+16:2364:x1875523174196736:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 196us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638545.903364:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 57 00010000:00010000:0.0:1788638545.904099:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b078 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f8f expref: 15 pid: 5842 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638545.904124:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f24380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875523183646592:192.168.203.34@tcp:104: 00010000:00010000:0.0:1788638545.904151:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b0be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.904162:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b0be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.904168:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b0be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.904208:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b0be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.904216:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b0be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.904223:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b0be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.904241:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638545.904246:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b0be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.904254:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b0be lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.904280:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c738a6e9700) 00010000:00010000:0.0:1788638545.904283:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788638545.904289:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b0be lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.904296:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b0be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638545.904368:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+14:10564:x1875523174196608:12345-192.168.203.34@tcp:55:lhsmtool_posix.0 Request processed in 6665us (7016us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788638545.904378:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 126 00000100:00100000:1.0:1788638545.907999:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638545.908235:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174196864 00000100:00100000:2.0:1788638545.908248:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174196864 00000100:00100000:2.0:1788638545.908340:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 45 00000100:00100000:2.0:1788638545.908353:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2365:x1875523174196864:12345-192.168.203.34@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788638545.908420:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006d2488ef/0xa0b1f1e3b4b2b0c5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.908443:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001b718493/0xa0b1f1e3b4b2b0a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fab expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.908453:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788638545.908457:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788638545.908462:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d2488ef/0xa0b1f1e3b4b2b0c5 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.908506:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001b718493/0xa0b1f1e3b4b2b0a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fab expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.908523:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001b718493/0xa0b1f1e3b4b2b0a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fab expref: 7 pid: 6687 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638545.908541:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b489b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6686:1875523183646720:192.168.203.34@tcp:104: 00000100:00100000:2.0:1788638545.908654:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398581b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788638545.912526:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638545.913695:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b489b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6686:1875523183646720:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638545.913765:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006d2488ef/0xa0b1f1e3b4b2b0c5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638545.913999:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174196992 00000100:00100000:3.0:1788638545.914009:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174196992 00010000:00010000:3.0:1788638545.914069:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b718493/0xa0b1f1e3b4b2b0a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fab expref: 8 pid: 6687 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638545.914113:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 58 00000100:00100000:3.0:1788638545.914123:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2365:x1875523174196992:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788638545.914143:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638545.914175:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b718493/0xa0b1f1e3b4b2b0a2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fab expref: 8 pid: 6687 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.914192:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b718493/0xa0b1f1e3b4b2b0a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fab expref: 8 pid: 6687 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.914227:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b718493/0xa0b1f1e3b4b2b0a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fab expref: 8 pid: 6687 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.914250:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788638545.914255:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788638545.914262:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006d2488ef/0xa0b1f1e3b4b2b0c5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.914273:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d2488ef/0xa0b1f1e3b4b2b0c5 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638545.914318:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638545.914403:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2365:x1875523174196992:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 280us (1890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638545.914420:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 58 00010000:00010000:2.0:1788638545.914572:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006d2488ef/0xa0b1f1e3b4b2b0c5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.914581:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d2488ef/0xa0b1f1e3b4b2b0c5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.914612:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000006d2488ef/0xa0b1f1e3b4b2b0c5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.914622:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d2488ef/0xa0b1f1e3b4b2b0c5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.914630:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d2488ef/0xa0b1f1e3b4b2b0c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.914637:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6400 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638545.914642:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d2488ef/0xa0b1f1e3b4b2b0c5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.914652:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d2488ef/0xa0b1f1e3b4b2b0c5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.914666:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d2488ef/0xa0b1f1e3b4b2b0c5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.914682:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d2488ef/0xa0b1f1e3b4b2b0c5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638545.914739:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2365:x1875523174196864:12345-192.168.203.34@tcp:1:lhsmtool_posix.0 Request processed in 6390us (6754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638545.914748:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 45 00000100:00100000:3.0:1788638545.920026:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638545.922466:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174197248 00000100:00100000:2.0:1788638545.922489:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174197248 00000100:00100000:2.0:1788638545.922646:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 127 00000100:00100000:2.0:1788638545.922658:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+14:10564:x1875523174197248:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788638545.922764:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b0cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.922827:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b0cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.922843:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b0cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.923137:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2b0d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.923148:0:7634:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b086 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f96 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.923157:0:7634:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2b0d3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.923220:0:7634:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b086 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f96 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.923235:0:7634:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b086 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f96 expref: 15 pid: 5842 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638545.923252:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b489b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7634:1875523183646848:192.168.203.34@tcp:104: 00000100:00100000:2.0:1788638545.923372:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398581b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788638545.931032:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b489b100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7634:1875523183646848:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638545.931278:0:7634:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2b0d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638545.934751:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638545.935471:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174197376 00000100:00100000:1.0:1788638545.935490:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174197376 00010000:00010000:1.0:1788638545.935557:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b086 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f96 expref: 16 pid: 5842 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638545.935612:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 59 00000100:00100000:1.0:1788638545.935624:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+16:2364:x1875523174197376:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638545.935643:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638545.935650:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b086 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f96 expref: 16 pid: 5842 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.935667:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b086 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f96 expref: 16 pid: 5842 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.935721:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b086 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f96 expref: 16 pid: 5842 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.935743:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c738a6e9700) 00010000:00010000:1.0:1788638545.935750:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2b0d3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.935761:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2b0d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.935769:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2b0d3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.935878:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638545.935953:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+15:2364:x1875523174197376:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 330us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638545.935962:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 59 00010000:00010000:0.0:1788638545.936349:0:7634:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2b0d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.936360:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2b0d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788638545.936626:0:7634:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1788638545.936845:0:7634:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1788638545.936894:0:7634:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1788638545.937002:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f24380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7634:1875523183646976:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788638545.937536:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638545.938287:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183646976 00000100:00100000:3.0:1788638545.938302:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183646976 00000100:00100000:2.0:1788638545.938543:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788638545.938557:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7634:x1875523183646976:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788638545.938678:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7634:x1875523183646976:12345-0@lo:1000:mdt00_003.0 Request processed in 123us (1144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638545.938686:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788638545.938909:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73915f9780 going to sleep for 11 seconds 00000100:00100000:1.0:1788638545.938942:0:7634:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788638545.938962:0:7634:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:1.0:1788638545.938994:0:7634:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c73837a7b80, transno 4294967309 00000004:00080000:1.0:1788638545.939009:0:7634:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c73837a4700, transno 4294967310 00000100:00100000:1.0:1788638545.939018:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f24380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7634:1875523183646976:0@lo:1000:mdt00_003.0 00000001:00080000:1.0:1788638545.939750:0:7634:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1788638545.939894:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f24380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7634:1875523183647104:0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788638545.939967:0:7634:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638545.939997:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304a480 going to sleep for 11 seconds 00000100:00100000:2.0:1788638545.940585:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183647104 00000100:00100000:2.0:1788638545.940596:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183647104 00000100:00100000:2.0:1788638545.940662:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788638545.940672:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7634:x1875523183647104:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788638545.940988:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7634:x1875523183647104:12345-0@lo:1000:mdt00_003.0 Request processed in 317us (1020us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788638545.940997:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788638545.942598:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f24380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7634:1875523183647104:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788638545.942661:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2b0d3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.942673:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2b0d3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.942681:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2b0d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.942688:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638545.942694:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2b0d3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.942703:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2b0d3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.942724:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c738a6e9700) 00010000:00010000:1.0:1788638545.942727:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788638545.942733:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2b0d3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.942740:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7600/0xa0b1f1e3b4b2b0d3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.942807:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2b016 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.942815:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2b016 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.942822:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2b016 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.942841:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638545.942845:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2b016 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.942852:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2b016 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.942862:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:1.0:1788638545.942864:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788638545.942872:0:7634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2b01d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f7a expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.942885:0:7634:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2b01d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f7a expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.942895:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2b01d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f7a expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.942938:0:7634:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2b01d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f7a expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638545.942956:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7634:1875523183647232:192.168.203.34@tcp:105: 00000100:00100000:1.0:1788638545.943146:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304a480 going to sleep for 11 seconds 00000100:00100000:3.0:1788638545.949333:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638545.949580:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7634:1875523183647232:192.168.203.34@tcp:105: 00010000:00010000:1.0:1788638545.949616:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2b016 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.949654:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2b016 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.949699:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b0da lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.949718:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b0da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.949733:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b0da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.949746:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b0da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.949753:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b0da lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.949760:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b0da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.949767:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638545.949771:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b0da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.949779:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b0da lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.949891:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:1.0:1788638545.949894:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638545.949898:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b0da lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.949911:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b0da lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.949922:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b0cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.949929:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b0cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.949935:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b0cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.949940:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638545.949943:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b0cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.949949:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b0cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.949957:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:1.0:1788638545.949959:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788638545.949962:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b0cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.949968:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b0cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788638545.950532:0:11706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788638545.950538:0:11706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788638545.951071:0:11706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788638545.951082:0:11706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788638545.951294:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+18:10564:x1875523174197248:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 Request processed in 28630us (31275us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1788638545.951318:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 127 00000020:00080000:1.0:1788638545.951343:0:7634:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788638545.951488:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174197504 00000100:00100000:2.0:1788638545.951507:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174197504 00000100:00100000:2.0:1788638545.951565:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 31 00000100:00100000:2.0:1788638545.951574:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+18:10563:x1875523174197504:12345-192.168.203.34@tcp:49:lfs.0 00000100:00100000:2.0:1788638545.951712:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+18:10563:x1875523174197504:12345-192.168.203.34@tcp:49:lfs.0 Request processed in 138us (2407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638545.951719:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 31 00000100:00100000:2.0:1788638545.959333:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638545.959545:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174197760 00000100:00100000:0.0:1788638545.959559:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174197760 00000100:00100000:0.0:1788638545.959636:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 32 00000100:00100000:0.0:1788638545.959648:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73a5716c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+18:10564:x1875523174197760:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788638545.960645:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638545.960738:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174198016 00000100:00100000:1.0:1788638545.960746:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174198016 00000100:00100000:1.0:1788638545.960815:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 128 00000100:00100000:1.0:1788638545.960825:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b489b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+20:10563:x1875523174198016:12345-192.168.203.34@tcp:58:lfs.0 00000040:00080000:1.0:1788638545.961134:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788638545.961234:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b489b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+20:10563:x1875523174198016:12345-192.168.203.34@tcp:58:lfs.0 Request processed in 409us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638545.961243:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 128 00000004:00080000:0.0:1788638545.963188:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788638545.968132:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1788638545.968242:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b0e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.974315:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b0e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.974408:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b0e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.974700:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b0e1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.974710:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b0e1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.974717:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b0e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638545.974842:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788638545.975001:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73a5716c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+20:10564:x1875523174197760:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 Request processed in 15348us (15692us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788638545.975048:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 32 00000020:00080000:1.0:1788638545.975055:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788638545.981173:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638545.981193:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b0e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.981207:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308c00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638545.981212:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b0e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.981233:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b0e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.981256:0:7639:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9c7398420c00) 00010000:00010000:2.0:1788638545.981259:0:7639:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788638545.981265:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b0e1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638545.981273:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b0e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.984189:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638545.984200:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638545.984204:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638545.998417:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638545.998963:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174198144 00000100:00100000:0.0:1788638545.998978:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174198144 00000100:00100000:0.0:1788638545.999059:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 129 00000100:00100000:0.0:1788638545.999072:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b489b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+20:10566:x1875523174198144:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638545.999105:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638545.999134:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b0e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434fb2 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.999226:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b0ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.999245:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b0ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.999261:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b0ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.999290:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b0f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.999298:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638545.999339:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638546.000053:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b0fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638546.000071:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b008 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f73 expref: 21 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638546.000081:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b0fd lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638546.000128:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b008 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f73 expref: 21 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638546.000145:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b008 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f73 expref: 21 pid: 7634 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638546.000163:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73c09a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875523183647360:192.168.203.34@tcp:104: 00000100:00100000:1.0:1788638546.000437:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788638546.003498:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638546.003601:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73c09a6300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875523183647360:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638546.003638:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b0fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638546.003839:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174198400 00000100:00100000:3.0:1788638546.003847:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174198400 00000100:00100000:3.0:1788638546.003925:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 33 00000100:00100000:3.0:1788638546.003936:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+22:5606:x1875523174198400:12345-192.168.203.34@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788638546.005215:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+23:5606:x1875523174198400:12345-192.168.203.34@tcp:35:ldlm_bl.0 Request processed in 1271us (1722us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1788638546.005227:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 33 00000100:00100000:0.0:1788638546.008737:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638546.009061:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174198528 00000100:00100000:3.0:1788638546.009074:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174198528 00010000:00010000:0.0:1788638546.009203:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b008 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f73 expref: 23 pid: 7634 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638546.009291:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 60 00000100:00100000:0.0:1788638546.009303:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dfb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+23:2364:x1875523174198528:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788638546.009339:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638546.009348:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b008 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f73 expref: 23 pid: 7634 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638546.009364:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b008 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f73 expref: 23 pid: 7634 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638546.009392:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b008 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f73 expref: 23 pid: 7634 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638546.009409:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:0.0:1788638546.009415:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b0fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638546.009934:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b0fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638546.009966:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b0fd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638546.010003:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638546.010078:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dfb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+22:2364:x1875523174198528:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 776us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638546.010088:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 60 00010000:00010000:2.0:1788638546.010205:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b0fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638546.010214:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b0fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638546.010272:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788638546.010277:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788638546.010314:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b0fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638546.010331:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b0fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638546.010342:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b0ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638546.010349:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b0ef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638546.010356:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b0ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638546.010362:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638546.010367:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b0ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638546.010375:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b0ef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638546.010387:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:2.0:1788638546.010397:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638546.010402:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b0ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638546.010409:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b0ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638546.010436:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638546.010442:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b0f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638546.010448:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b0f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638546.010453:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638546.010456:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b0f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638546.010462:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b0f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638546.010470:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9c73a1cf7000) 00010000:00010000:2.0:1788638546.010472:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638546.010475:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b0f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638546.010480:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b0f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638546.010524:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b0e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fb2 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638546.010554:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b0fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fb2 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638546.010562:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:2.0:1788638546.010564:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788638546.010567:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309c00, rc 0) 00000100:00100000:2.0:1788638546.010602:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b489b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+21:10566:x1875523174198144:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 11534us (12200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638546.010610:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 129 00010000:00010000:1.0:1788638546.850119:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788638546.976144:0:11706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788638546.976157:0:11706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788638546.976231:0:11706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788638546.976239:0:11706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788638546.976431:0:11706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387dbf480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11706:1875523183647488:192.168.203.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788638546.976569:0:11706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bc01a840 going to sleep for 11 seconds 00000100:00100000:3.0:1788638546.981381:0:11706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387dbf480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11706:1875523183647488:192.168.203.34@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788638546.985351:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638546.985437:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174198656 00000100:00100000:1.0:1788638546.985449:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174198656 00000100:00100000:1.0:1788638546.985516:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 130 00000100:00100000:1.0:1788638546.985526:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b489bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+21:10577:x1875523174198656:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788638546.985573:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788638546.985715:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b489bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+21:10577:x1875523174198656:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 Request processed in 190us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638546.985740:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 130 00000100:00100000:0.0:1788638546.997579:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638546.998438:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174198912 00000100:00100000:1.0:1788638546.998452:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174198912 00000100:00100000:1.0:1788638546.998524:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 131 00000100:00100000:1.0:1788638546.998534:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+21:10577:x1875523174198912:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788638546.998559:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638546.998584:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b104 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434fb9 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638546.998707:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b10b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638546.998726:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b10b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638546.998741:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b10b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788638546.998961:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788638546.999128:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b104 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fb9 expref: 24 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638546.999147:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b10b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fb9 expref: 23 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638546.999158:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:1.0:1788638546.999161:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788638546.999166:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385308a00, rc 0) 00000100:00100000:1.0:1788638546.999377:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+23:10577:x1875523174198912:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 842us (1810us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788638546.999387:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 131 00000100:00100000:0.0:1788638547.019222:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638547.019332:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174199040 00000100:00100000:1.0:1788638547.019346:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174199040 00000100:00100000:1.0:1788638547.019445:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:1.0:1788638547.019457:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+23:2364:x1875523174199040:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638547.019478:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638547.019512:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b10b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fb9 expref: 23 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638547.019532:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:1.0:1788638547.019539:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638547.019616:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+22:2364:x1875523174199040:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 160us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638547.019624:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00080000:0.0:1788638547.020201:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638547.030269:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638547.030358:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174199296 00000100:00100000:1.0:1788638547.030371:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174199296 00000100:00100000:1.0:1788638547.030448:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 132 00000100:00100000:1.0:1788638547.030461:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+22:10577:x1875523174199296:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788638547.030570:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b119 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638547.030592:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b119 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638547.030607:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b119 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638547.030910:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b119 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638547.030919:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b119 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638547.030926:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b119 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638547.030933:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638547.030938:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b119 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638547.030947:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b119 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638547.030961:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:1.0:1788638547.030965:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788638547.030971:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b119 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638547.030977:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b119 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638547.031170:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+23:10577:x1875523174199296:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 Request processed in 710us (923us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788638547.031180:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 132 00000040:00080000:3.0:1788638547.031912:0:11706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788638547.031920:0:11706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788638547.032427:0:11706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788638547.032440:0:11706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788638547.033401:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638547.033522:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174199552 00000100:00100000:3.0:1788638547.033534:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174199552 00000100:00100000:3.0:1788638547.033593:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 34 00000100:00100000:3.0:1788638547.033604:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+23:10577:x1875523174199552:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788638547.034003:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+24:10577:x1875523174199552:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 Request processed in 398us (611us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788638547.034012:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 34 00000040:00080000:2.0:1788638547.149151:0:12082:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788638547.149161:0:12082:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788638547.149230:0:12082:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788638547.149237:0:12082:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788638547.372085:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638547.372233:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174199808 00000100:00100000:3.0:1788638547.372247:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174199808 00000100:00100000:3.0:1788638547.372394:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 133 00000100:00100000:3.0:1788638547.372406:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+24:10590:x1875523174199808:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:3.0:1788638547.372631:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638547.372659:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b120 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434fc0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638547.372949:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2b127 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638547.372968:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2b127 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638547.372982:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2b127 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638547.373016:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788638547.373181:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b120 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fc0 expref: 27 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638547.373204:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2b127 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fc0 expref: 26 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638547.373214:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:3.0:1788638547.373217:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788638547.373221:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030400, rc 0) 00000100:00100000:3.0:1788638547.373634:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4892300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+26:10590:x1875523174199808:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 1226us (1560us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788638547.373644:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 133 00000100:00100000:3.0:1788638547.390286:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638547.390778:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174199936 00000100:00100000:1.0:1788638547.390835:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174199936 00000100:00100000:1.0:1788638547.390906:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 134 00000100:00100000:1.0:1788638547.390918:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+26:10590:x1875523174199936:12345-192.168.203.34@tcp:54:lfs.0 00010000:00010000:1.0:1788638547.391020:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b135 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638547.391056:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638547.391072:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638547.391104:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b135 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638547.391110:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b135 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638547.391118:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b135 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638547.391124:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638547.391130:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b135 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638547.391137:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b135 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638547.391151:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:1.0:1788638547.391153:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788638547.391159:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b135 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638547.392230:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b135 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638547.392365:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+26:10590:x1875523174199936:12345-192.168.203.34@tcp:54:lfs.0 Request processed in 1445us (2090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638547.392377:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 134 00000100:00100000:1.0:1788638547.514321:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638547.514469:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174200064 00000100:00100000:0.0:1788638547.514486:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174200064 00000100:00100000:0.0:1788638547.514623:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 46 00000100:00100000:0.0:1788638547.514637:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2367:x1875523174200064:12345-192.168.203.34@tcp:101:cat.0 00010000:00010000:0.0:1788638547.514660:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638547.514685:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2b13c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434fc7 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788638547.514721:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c7551, atime: 0x6a9c7551, ctime: 0x6a9c7551, blocks: 0xb 00010000:00010000:0.0:1788638547.514748:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=310s v=(0 0) 00010000:00010000:0.0:1788638547.514753:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638547.514764:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2b13c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fc7 expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638547.514832:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2b13c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fc7 expref: 7 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638547.514869:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01cc00, rc 0) 00000100:00080000:2.0:1788638547.515008:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788638547.515026:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4891f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2367:x1875523174200064:12345-192.168.203.34@tcp:101:cat.0 Request processed in 386us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638547.515039:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 46 00000100:00100000:3.0:1788638547.519419:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638547.519548:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174200192 00000100:00100000:2.0:1788638547.519561:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174200192 00002000:00100000:2.0:1788638547.519629:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9c7387dbfb80 x1875523174200192/t0(0) o3->00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp:523/0 lens 488/0 e 0 to 0 dl 1788638558 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788638547.519642:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7387dbfb80 with x1875523174200192 ext(0->4095) 00002000:00010000:2.0:1788638547.519649:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c7387dbfb80 00000100:00100000:2.0:1788638547.519682:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 3 00000100:00100000:2.0:1788638547.519691:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2366:x1875523174200192:12345-192.168.203.34@tcp:3:cat.0 00000100:00100000:2.0:1788638547.520046:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2366:x1875523174200192:12345-192.168.203.34@tcp:3:cat.0 Request processed in 354us (638us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788638547.520074:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 3 00002000:00100000:2.0:1788638547.520081:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9c7387dbfb80 x1875523174200192/t0(0) o3->00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp:523/0 lens 488/4536 e 0 to 0 dl 1788638558 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788638547.520090:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7387dbfb80 with x1875523174200192 ext(0->4095) 00002000:00010000:2.0:1788638547.520093:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c7387dbfb80 00010000:00010000:1.0:1788638547.872130:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638548.192165:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788638548.195201:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183647616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788638548.195331:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638548.195563:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183647616 00000100:00100000:1.0:1788638548.195574:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183647616 00000100:00100000:1.0:1788638548.195660:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788638548.195672:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1875523183647616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788638548.195722:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788638548.195780:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4898000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1875523183647616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638548.195813:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788638548.196315:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183647616:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788638548.199738:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788638548.240130:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638548.240187:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638548.240225:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638548.240256:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638548.240288:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638548.240339:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174200832 00000100:00100000:0.0:1788638548.240351:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174200832 00000100:00100000:3.0:1788638548.240426:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174200448 00000100:00100000:3.0:1788638548.240433:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174200448 00000100:00100000:0.0:1788638548.240456:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 144 00000100:00100000:1.0:1788638548.240703:0:11999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174200576 00000100:00100000:1.0:1788638548.240708:0:11999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174200576 00000100:00100000:1.0:1788638548.240746:0:11999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174200704 00000100:00100000:1.0:1788638548.240749:0:11999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174200704 00000100:00100000:1.0:1788638548.240770:0:11999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 79 00000100:00100000:1.0:1788638548.240814:0:11999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2367:x1875523174200576:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638548.240906:0:11999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2367:x1875523174200576:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 127us (718us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638548.240934:0:11999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 79 00000100:00100000:1.0:1788638548.240954:0:11999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 80 00000100:00100000:1.0:1788638548.240960:0:11999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2367:x1875523174200704:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638548.241001:0:11999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2367:x1875523174200704:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 40us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638548.241007:0:11999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 80 00000100:00080000:1.0:1788638548.241166:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788638548.241172:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638548.241244:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174200320 00000100:00100000:2.0:1788638548.241250:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174200320 00000100:00100000:2.0:1788638548.241288:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 292 00000100:00100000:2.0:1788638548.241307:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+13:2367:x1875523174200320:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638548.241345:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383682050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:55273f9a-386c-4321-9748-c194b047efe8+13:2367:x1875523174200320:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 40us (1230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638548.241351:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 292 00000100:00100000:0.0:1788638548.241904:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2367:x1875523174200832:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638548.241975:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2367:x1875523174200832:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 70us (1741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638548.241986:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 145 00000100:00100000:3.0:1788638548.241997:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+26:2367:x1875523174200448:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638548.242031:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+26:2367:x1875523174200448:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 37us (1774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638548.242405:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 145 00000100:00100000:0.0:1788638548.244196:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 144 00010000:00010000:0.0:1788638548.896022:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638549.920421:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638550.243062:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4892680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183647872:0@lo:400:kworker.0 00000100:00100000:1.0:1788638550.243164:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638550.243250:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183648384:0@lo:400:kworker.0 00000100:00100000:1.0:1788638550.243293:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638550.243330:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788638550.243336:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183647744:0@lo:400:kworker.0 00000100:00100000:1.0:1788638550.243388:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638550.243410:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183648256:0@lo:400:kworker.0 00000100:00100000:2.0:1788638550.243541:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7398bf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183648000:0@lo:400:kworker.0 00000100:00100000:2.0:1788638550.243576:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638550.243603:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788638550.243609:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183648128:0@lo:400:kworker.0 00000100:00100000:2.0:1788638550.243635:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638550.243672:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183647872 00000100:00100000:2.0:1788638550.243683:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183647872 00000100:00100000:2.0:1788638550.243741:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183648000 00000100:00100000:2.0:1788638550.243754:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183648000 00000100:00100000:2.0:1788638550.243831:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788638550.243842:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183647872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638550.243903:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183647872:12345-0@lo:400:kworker.0 Request processed in 62us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638550.243911:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788638550.243930:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788638550.243937:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183648000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638550.243970:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4899180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183648000:12345-0@lo:400:kworker.0 Request processed in 34us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638550.243976:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788638550.244000:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183648384 00000100:00100000:2.0:1788638550.244003:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183648384 00000100:00100000:2.0:1788638550.244030:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183648128 00000100:00100000:2.0:1788638550.244033:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183648128 00000100:00100000:2.0:1788638550.244053:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788638550.244059:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3294:x1875523183648384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638550.244089:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3294:x1875523183648384:12345-0@lo:400:kworker.0 Request processed in 30us (796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638550.244094:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788638550.244105:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788638550.244110:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b489a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3291:x1875523183648128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638550.244138:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b489a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3291:x1875523183648128:12345-0@lo:400:kworker.0 Request processed in 27us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638550.244144:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:2.0:1788638550.244162:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788638550.244166:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788638550.244175:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638550.244224:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183648128:0@lo:400:kworker.0 00000100:00100000:2.0:1788638550.244235:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7398bf8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183648000:0@lo:400:kworker.0 00000100:00100000:2.0:1788638550.244302:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183647744 00000100:00100000:2.0:1788638550.244307:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183647744 00000100:00100000:2.0:1788638550.244334:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788638550.244340:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183647744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638550.244378:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383682c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183647744:12345-0@lo:400:kworker.0 Request processed in 38us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638550.244384:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788638550.244751:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638550.244811:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4892680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183647872:0@lo:400:kworker.0 00000100:00100000:1.0:1788638550.244826:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387d9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183648384:0@lo:400:kworker.0 00000100:00100000:1.0:1788638550.244860:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4891880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183647744:0@lo:400:kworker.0 00000100:00100000:2.0:1788638550.244991:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183648256 00000100:00100000:2.0:1788638550.244996:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183648256 00000100:00100000:2.0:1788638550.245046:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788638550.245054:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183648256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638550.245095:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183648256:12345-0@lo:400:kworker.0 Request processed in 41us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638550.245102:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:1.0:1788638550.245171:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788638550.245195:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387d9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183648256:0@lo:400:kworker.0 00000100:00100000:3.0:1788638550.752284:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183648512:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788638550.752374:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638550.752552:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183648512 00000100:00100000:3.0:1788638550.752566:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183648512 00000100:00100000:3.0:1788638550.752619:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788638550.752628:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1875523183648512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788638550.752673:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788638550.752725:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3291:x1875523183648512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638550.752732:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788638550.753109:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387dbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183648512:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788638550.820725:0:11986:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967408 is committed 00000001:00080000:0.0:1788638550.820725:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:0.0:1788638550.820750:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c728304a840 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788638550.820756:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c73bbcde200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c728304a000 00000020:00080000:0.0:1788638550.820890:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c73bbcde700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c73bf62b800 00000001:00080000:0.0:1788638550.820921:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1788638550.820945:0:11986:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788638550.821034:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788638550.821396:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1788638550.843284:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:2.0:1788638550.943976:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788638551.358583:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:0.0:1788638551.362872:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:0.0:1788638551.968406:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638552.784846:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638552.787600:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174200960 00000100:00100000:2.0:1788638552.787615:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174200960 00000100:00100000:2.0:1788638552.787770:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 135 00000100:00100000:2.0:1788638552.787795:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+13:10251:x1875523174200960:12345-192.168.203.34@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788638552.787906:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+13:10251:x1875523174200960:12345-192.168.203.34@tcp:60:lhsmtool_posix.0 Request processed in 126us (3069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638552.787913:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 135 00000100:00080000:1.0:1788638552.790713:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788638552.795101:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638552.795239:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174201216 00000100:00100000:3.0:1788638552.795249:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174201216 00000100:00100000:3.0:1788638552.795314:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 35 00000100:00100000:3.0:1788638552.795326:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+13:10251:x1875523174201216:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788638552.795715:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+14:10251:x1875523174201216:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 Request processed in 392us (622us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788638552.795723:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 35 00010000:00010000:1.0:1788638552.991982:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638553.261623:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638553.261820:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174201344 00000100:00100000:2.0:1788638553.261844:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174201344 00000100:00100000:2.0:1788638553.261918:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 136 00000100:00100000:2.0:1788638553.261928:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:11042:x1875523174201344:12345-192.168.203.34@tcp:101:lsof.0 00010000:00010000:2.0:1788638553.261946:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638553.261967:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b143 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434fce expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638553.262038:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b14a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638553.262054:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b14a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638553.262067:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b14a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638553.262103:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788638553.262116:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788638553.262157:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b14a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638553.262181:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b143 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fce expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638553.262198:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b14a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fce expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638553.262207:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:2.0:1788638553.262210:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788638553.262213:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7400, rc 0) 00000100:00100000:2.0:1788638553.262291:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdbf9a9f-afb3-447e-b3b7-3039526706d5+6:11042:x1875523174201344:12345-192.168.203.34@tcp:101:lsof.0 Request processed in 364us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638553.262298:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 136 00000100:00080000:1.0:1788638553.262469:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638553.312870:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638553.313562:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183648640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788638553.314119:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638553.320961:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183648640 00000100:00100000:3.0:1788638553.321027:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183648640 00000100:00100000:3.0:1788638553.321165:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788638553.321176:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183648640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788638553.321215:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788638553.321309:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183648640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 135us (7190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638553.321332:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788638553.321392:0:3291:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1788638553.321398:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c73837a5500, transno 4294967304 00000100:00100000:3.0:1788638553.321421:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387dbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183648640:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788638553.329440:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788638553.347591:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638553.347727:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174201472 00000100:00100000:2.0:1788638553.347737:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174201472 00000100:00100000:2.0:1788638553.347822:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 294 00000100:00100000:2.0:1788638553.347839:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+13:2365:x1875523174201472:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638553.347906:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383680050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+13:2365:x1875523174201472:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 75us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638553.347913:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 294 00000100:00100000:0.0:1788638553.354316:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638553.354431:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174201600 00000100:00100000:2.0:1788638553.354440:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174201600 00000100:00100000:2.0:1788638553.354517:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 149 00000100:00100000:2.0:1788638553.354526:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+14:2365:x1875523174201600:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638553.354626:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+14:2365:x1875523174201600:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 100us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638553.355113:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 149 00000100:00100000:0.0:1788638553.364989:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638553.365100:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638553.375065:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174201856 00000100:00100000:2.0:1788638553.375079:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174201856 00000100:00100000:2.0:1788638553.375158:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174201728 00000100:00100000:2.0:1788638553.375162:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174201728 00000100:00100000:2.0:1788638553.375194:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 83 00000100:00100000:2.0:1788638553.375204:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174201856:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638553.375287:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174201856:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 84us (10307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638553.375295:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 83 00000100:00100000:2.0:1788638553.375326:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 84 00000100:00100000:2.0:1788638553.375333:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2365:x1875523174201728:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638553.375360:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2365:x1875523174201728:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 28us (10261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638553.375366:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 84 00000100:00080000:1.0:1788638553.375431:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788638553.375436:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788638554.016000:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788638554.208050:0:11706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788638554.208059:0:11706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788638554.208493:0:11706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788638554.208501:0:11706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788638555.040054:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638555.360327:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bc076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183649024:0@lo:400:kworker.0 00000100:00100000:3.0:1788638555.360401:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638555.360541:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bc077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183648896:0@lo:400:kworker.0 00000100:00100000:1.0:1788638555.360574:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638555.360600:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788638555.360605:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bc075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183648768:0@lo:400:kworker.0 00000100:00100000:1.0:1788638555.360645:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638555.360680:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bc074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183649152:0@lo:400:kworker.0 00000100:00100000:1.0:1788638555.360707:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638555.361018:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183648768 00000100:00100000:2.0:1788638555.361025:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183648768 00000100:00100000:2.0:1788638555.361090:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788638555.361100:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183648768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638555.361176:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383681050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183648768:12345-0@lo:400:kworker.0 Request processed in 76us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638555.361183:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788638555.361231:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bc075880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183648768:0@lo:400:kworker.0 00000100:00100000:2.0:1788638555.361269:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183649152 00000100:00100000:2.0:1788638555.361273:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183649152 00000100:00100000:2.0:1788638555.361308:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788638555.361315:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183649152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638555.361350:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183649152:12345-0@lo:400:kworker.0 Request processed in 36us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638555.361356:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1788638555.361377:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788638555.361388:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183649024 00000100:00100000:2.0:1788638555.361392:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183649024 00000100:00100000:2.0:1788638555.361419:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183648896 00000100:00100000:2.0:1788638555.361422:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183648896 00000100:00100000:2.0:1788638555.361443:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788638555.361466:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183649024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638555.361554:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bc074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183649152:0@lo:400:kworker.0 00000100:00100000:1.0:1788638555.361593:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788638555.361602:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183648896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638555.361649:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183648896:12345-0@lo:400:kworker.0 Request processed in 49us (1074us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638555.361655:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788638555.362551:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bc075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183649280:0@lo:400:kworker.0 00000100:00100000:1.0:1788638555.362605:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638555.362950:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788638555.362958:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bc077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183649408:0@lo:400:kworker.0 00000100:00100000:1.0:1788638555.362991:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638555.363055:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183649280 00000100:00100000:1.0:1788638555.363061:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183649280 00000100:00100000:1.0:1788638555.363102:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788638555.363111:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183649280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638555.363154:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183649280:12345-0@lo:400:kworker.0 Request processed in 45us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638555.363161:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788638555.363196:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bc075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183649280:0@lo:400:kworker.0 00000100:00100000:1.0:1788638555.363231:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183649408 00000100:00100000:1.0:1788638555.363235:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183649408 00000100:00100000:1.0:1788638555.363282:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788638555.363288:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183649408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638555.363321:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183649408:12345-0@lo:400:kworker.0 Request processed in 34us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638555.363328:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788638555.363348:0:3293:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1788638555.363353:0:3293:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:1.0:1788638555.363369:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bc077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183649408:0@lo:400:kworker.0 00000100:00100000:1.0:1788638555.363404:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bc077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183648896:0@lo:400:kworker.0 00000100:00080000:1.0:1788638555.363419:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788638555.363423:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638555.366549:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183649024:12345-0@lo:400:kworker.0 Request processed in 5072us (6137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638555.366564:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788638555.368552:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bc076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183649024:0@lo:400:kworker.0 00000100:00100000:1.0:1788638555.872069:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788638555.872104:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183649536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788638555.872177:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638555.872526:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183649536 00000100:00100000:3.0:1788638555.872535:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183649536 00000100:00100000:3.0:1788638555.872591:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788638555.872600:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183649536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788638555.872635:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788638555.872697:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183649536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638555.872705:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788638555.872964:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183649536:0@lo:13:osp-pre-1-0.0 00000020:00080000:1.0:1788638555.920959:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788638555.921014:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788638555.921025:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:3.0:1788638555.921183:0:11986:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00010000:00010000:1.0:1788638556.067009:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788638556.901778:0:12283:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 16:02:35 (1788638555) 00010000:00010000:2.0:1788638557.093721:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638558.111964:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638558.433721:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638558.433743:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183649664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788638558.433857:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638558.434549:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183649664 00000100:00100000:3.0:1788638558.434558:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183649664 00000100:00100000:3.0:1788638558.434622:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788638558.434630:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b498e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183649664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788638558.434664:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788638558.434734:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b498e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183649664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (877us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638558.434741:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788638558.435074:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183649664:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788638558.435193:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788638558.443003:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638558.449437:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174202112 00000100:00100000:1.0:1788638558.449453:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174202112 00000100:00100000:3.0:1788638558.449827:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 137 00000100:00100000:3.0:1788638558.449840:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+13:11307:x1875523174202112:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788638558.449860:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638558.449890:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b151 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434fd5 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788638558.449908:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788638558.449971:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b158 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.449986:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b158 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.449997:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b158 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.450011:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b15f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.450017:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b15f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.450023:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b15f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.450278:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b166 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.450299:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b166 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.450307:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b166 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638558.450317:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788638558.451774:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b158 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.451820:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b158 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.451826:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b158 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.451832:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638558.451836:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b158 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.451844:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b158 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.451859:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c7398420300) 00010000:00010000:3.0:1788638558.451862:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638558.451867:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b158 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.451872:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b158 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.451885:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b15f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.451910:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b15f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.451916:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b15f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.451922:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638558.451925:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b15f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.451930:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b15f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.451939:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c7393e81e00) 00010000:00010000:3.0:1788638558.451941:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638558.451944:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b15f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.451950:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b15f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.454363:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b151 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fd5 expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.454388:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b166 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fd5 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638558.454398:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c73a1cf7600) 00010000:00010000:3.0:1788638558.454401:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638558.454412:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030000, rc 0) 00000100:00100000:3.0:1788638558.454536:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+15:11307:x1875523174202112:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 4697us (11540us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788638558.454546:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 137 00000100:00100000:0.0:1788638558.468913:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638558.469065:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174202240 00000100:00100000:1.0:1788638558.469080:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174202240 00000100:00100000:0.0:1788638558.469121:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638558.469168:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638558.469229:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 138 00000100:00100000:1.0:1788638558.469243:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+15:11307:x1875523174202240:12345-192.168.203.34@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788638558.469368:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+15:11307:x1875523174202240:12345-192.168.203.34@tcp:59:lhsmtool_posix.0 Request processed in 128us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638558.469376:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 138 00000100:00100000:2.0:1788638558.469490:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174202368 00000100:00100000:2.0:1788638558.469495:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174202368 00000100:00100000:2.0:1788638558.469535:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:2.0:1788638558.469543:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc076300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+15:2365:x1875523174202368:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638558.469555:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638558.469580:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b166 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fd5 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638558.469603:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c73a1cf7600) 00010000:00010000:2.0:1788638558.469610:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638558.469637:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc076300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+14:2365:x1875523174202368:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 95us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638558.469645:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:3.0:1788638558.469769:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174202496 00000100:00100000:3.0:1788638558.469779:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174202496 00000100:00100000:0.0:1788638558.469901:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638558.469939:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174202752 00000100:00100000:0.0:1788638558.469943:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174202752 00000100:00100000:2.0:1788638558.470509:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638558.470542:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638558.470566:0:11999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174202624 00000100:00100000:2.0:1788638558.470572:0:11999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174202624 00000100:00100000:2.0:1788638558.470617:0:11999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 87 00000100:00100000:2.0:1788638558.470625:0:11999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2366:x1875523174202624:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638558.470682:0:11999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4898a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2366:x1875523174202624:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 58us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638558.470690:0:11999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 87 00000100:00080000:2.0:1788638558.470762:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788638558.470772:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174202880 00000100:00100000:2.0:1788638558.470776:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174202880 00000100:00100000:2.0:1788638558.472756:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 153 00000100:00100000:2.0:1788638558.472778:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b489a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdbf9a9f-afb3-447e-b3b7-3039526706d5+6:2366:x1875523174202880:12345-192.168.203.34@tcp:400:kworker.0 00000100:00080000:3.0:1788638558.473281:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638558.473371:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 296 00000100:00100000:3.0:1788638558.473382:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:2366:x1875523174202496:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638558.473639:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b489a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdbf9a9f-afb3-447e-b3b7-3039526706d5+6:2366:x1875523174202880:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 869us (3093us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638558.473648:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 153 00000100:00100000:0.0:1788638558.473872:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 88 00000100:00100000:0.0:1788638558.473886:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2366:x1875523174202752:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638558.474558:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2366:x1875523174202752:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 671us (4862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638558.474570:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 88 00000100:00080000:2.0:1788638558.474653:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788638558.475590:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383681850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:2366:x1875523174202496:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 2203us (6415us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638558.475602:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 296 00010000:00010000:2.0:1788638559.136468:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788638559.328032:0:11706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788638559.328041:0:11706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788638559.328076:0:11706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788638559.328084:0:11706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788638560.160139:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638560.256002:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638560.256085:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174203008 00000100:00100000:3.0:1788638560.256095:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174203008 00000100:00080000:0.0:1788638560.256158:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638560.256181:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 139 00000100:00100000:3.0:1788638560.256192:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+14:11349:x1875523174203008:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:3.0:1788638560.256218:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638560.256239:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b174 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434fdc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.256298:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b17b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.256314:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b17b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.256325:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b17b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.256351:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b182 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.256359:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b182 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.256366:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b182 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.256635:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b17b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.256643:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b17b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.256649:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b17b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.256655:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638560.256660:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b17b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.256668:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b17b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.256680:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:3.0:1788638560.256683:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638560.256688:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b17b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.256695:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b17b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.256712:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b182 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.256719:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b182 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.256725:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b182 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.256731:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638560.256735:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b182 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.256741:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b182 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.256751:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c7393e81e00) 00010000:00010000:3.0:1788638560.256754:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638560.256757:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b182 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.256764:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b182 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.257070:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b174 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fdc expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.257080:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:3.0:1788638560.257083:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638560.257094:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b174 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fdc expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.257104:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030c00, rc 0) 00000100:00100000:3.0:1788638560.257164:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+14:11349:x1875523174203008:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 973us (1168us total) trans 0 rc 301/301 00000100:00100000:3.0:1788638560.257278:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 139 00000100:00100000:3.0:1788638560.265634:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638560.266904:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174203264 00000100:00100000:1.0:1788638560.266916:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174203264 00000100:00100000:1.0:1788638560.266984:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 140 00000100:00100000:1.0:1788638560.266995:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+14:11349:x1875523174203264:12345-192.168.203.34@tcp:36:lfs.0 00010000:00010000:1.0:1788638560.267050:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638560.267077:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2aaf2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e15 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.267094:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:1.0:1788638560.267099:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788638560.267319:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b189 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.267334:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b14a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fce expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.267344:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b189 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.267384:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b14a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fce expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.267399:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b14a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fce expref: 5 pid: 5844 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638560.267413:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387d9dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875523183649792:192.168.203.34@tcp:104: 00000100:00100000:1.0:1788638560.267504:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788638560.278047:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638560.281688:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387d9dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875523183649792:192.168.203.34@tcp:104: 00010000:00010000:3.0:1788638560.281717:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b189 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638560.282565:0:11689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174203392 00000100:00100000:1.0:1788638560.282574:0:11689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174203392 00010000:00010000:1.0:1788638560.282674:0:11689:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b14a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fce expref: 6 pid: 5844 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638560.282717:0:11689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 61 00000100:00100000:1.0:1788638560.282727:0:11689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc075f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdbf9a9f-afb3-447e-b3b7-3039526706d5+6:2364:x1875523174203392:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638560.282743:0:11689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638560.282750:0:11689:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b14a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fce expref: 6 pid: 5844 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.282763:0:11689:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b14a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fce expref: 6 pid: 5844 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.282811:0:11689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b14a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fce expref: 6 pid: 5844 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.282827:0:11689:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:1.0:1788638560.282845:0:11689:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b189 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.282855:0:11689:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b189 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.282863:0:11689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b189 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.282889:0:11689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638560.282950:0:11689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc075f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2364:x1875523174203392:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 224us (4912us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638560.282958:0:11689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 61 00010000:00010000:3.0:1788638560.283852:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b189 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.283863:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b189 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.283889:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b190 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.283899:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b190 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.283908:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b190 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638560.285954:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788638560.285971:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b189 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.285993:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b189 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.286001:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b189 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.286006:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638560.286011:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b189 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.286019:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b189 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.286035:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:3.0:1788638560.286039:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638560.286044:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b189 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.286050:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b189 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788638560.286069:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f9f8dcc6 reply state 0000000074eee638 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b190 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638560.286077:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00080000:0.0:1788638560.287093:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638560.288347:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+15:11349:x1875523174203264:12345-192.168.203.34@tcp:36:lfs.0 Request processed in 19176us (20544us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788638560.288359:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 140 00010000:00010000:2.0:1788638560.295496:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b190 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.295514:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b190 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.295522:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b190 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.295528:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638560.295534:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b190 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.295557:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b190 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.295574:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c7393e81e00) 00010000:00010000:2.0:1788638560.295577:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638560.295582:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b190 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.295589:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b190 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638560.403714:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638560.403823:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174203520 00000100:00100000:1.0:1788638560.403833:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174203520 00000100:00100000:1.0:1788638560.403891:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 141 00000100:00100000:1.0:1788638560.403901:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+14:11357:x1875523174203520:12345-192.168.203.34@tcp:101:lctl.0 00010000:00010000:1.0:1788638560.403924:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638560.403946:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b197 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434fe3 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.404006:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2b19e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.404020:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2b19e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.404031:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2b19e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788638560.404063:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788638560.404078:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788638560.404103:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2b19e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.404128:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b197 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fe3 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.404146:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2b19e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fe3 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.404155:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7398420a00) 00010000:00010000:1.0:1788638560.404158:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788638560.404161:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309400, rc 0) 00000100:00100000:1.0:1788638560.404241:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4898380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+15:11357:x1875523174203520:12345-192.168.203.34@tcp:101:lctl.0 Request processed in 341us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638560.404248:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 141 00000100:00100000:0.0:1788638560.461529:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638560.461602:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174203648 00000100:00100000:3.0:1788638560.461613:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174203648 00000100:00100000:3.0:1788638560.461692:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 142 00000100:00100000:3.0:1788638560.461703:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+15:11363:x1875523174203648:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:3.0:1788638560.461723:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638560.461740:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b1a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434fea expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.461831:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b1ac lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.461847:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b1ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.461858:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b1ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.461874:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b1b3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.461881:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.461888:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.461980:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b1ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.461989:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b1ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.461996:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b1ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638560.462035:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788638560.462039:0:7634:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788638560.462057:0:7634:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b1ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.462069:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b1ac lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.462075:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b1ac lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.462082:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b1ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.462088:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638560.462092:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b1ac lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.462100:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b1ac lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.462112:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7398420a00) 00010000:00010000:3.0:1788638560.462115:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638560.462120:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b1ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.462127:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b1ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.462140:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b1b3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.462155:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b1b3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.462161:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b1b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.462166:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638560.462169:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b1b3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.462175:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b1b3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.462184:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9c7393e81100) 00010000:00010000:3.0:1788638560.462187:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638560.462189:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b1b3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.462195:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b1b3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.464609:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b1a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fea expref: 17 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.464639:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b1ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fea expref: 16 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.464651:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:3.0:1788638560.464654:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788638560.464674:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030c00, rc 0) 00000100:00100000:3.0:1788638560.464749:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+16:11363:x1875523174203648:12345-192.168.203.34@tcp:101:bash.0 Request processed in 3047us (3228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638560.464758:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 142 00000100:00100000:0.0:1788638560.477503:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638560.477664:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174203904 00000100:00100000:2.0:1788638560.477674:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174203904 00000100:00100000:2.0:1788638560.477733:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 143 00000100:00100000:2.0:1788638560.477744:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+16:11363:x1875523174203904:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:2.0:1788638560.477764:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638560.477802:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2b1c1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434ff1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.477919:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b1c8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.477934:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b1c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.477945:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b1c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.478010:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b1cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.478032:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b1cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.478039:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b1cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788638560.479856:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788638560.480035:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b1d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.480050:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b1d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.480062:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b1d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.480098:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b1c8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.480106:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b1c8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.480114:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b1c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.480120:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638560.480124:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b1c8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.480132:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b1c8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.480157:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:2.0:1788638560.480160:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638560.480165:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b1c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.480172:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b1c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788638560.480185:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ef141884 reply state 00000000d1c36b9c transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b1cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638560.480195:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788638560.480241:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2b1c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ff1 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.480256:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b1d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ff1 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.480265:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c738a6e9e00) 00010000:00010000:2.0:1788638560.480268:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788638560.480270:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6400, rc 0) 00000100:00100000:1.0:1788638560.481076:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183649920:0@lo:400:kworker.0 00000100:00100000:1.0:1788638560.481135:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638560.481191:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183650432:0@lo:400:kworker.0 00000100:00100000:1.0:1788638560.481228:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638560.481255:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788638560.481261:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183650048:0@lo:400:kworker.0 00000100:00100000:1.0:1788638560.481282:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638560.481301:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183650560:0@lo:400:kworker.0 00000100:00100000:1.0:1788638560.481325:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638560.481407:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183650304:0@lo:400:kworker.0 00000100:00100000:0.0:1788638560.481539:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183650176:0@lo:400:kworker.0 00000100:00100000:0.0:1788638560.481569:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638560.481600:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183650432 00000100:00100000:0.0:1788638560.481607:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183650432 00000100:00100000:0.0:1788638560.481649:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183650048 00000100:00100000:0.0:1788638560.481652:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183650048 00000100:00100000:0.0:1788638560.481664:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183650176 00000100:00100000:0.0:1788638560.481666:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183650176 00000100:00100000:0.0:1788638560.481681:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788638560.481688:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183650432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638560.481735:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183650432:12345-0@lo:400:kworker.0 Request processed in 47us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638560.481741:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788638560.481757:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788638560.481763:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183650048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638560.481814:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183650048:12345-0@lo:400:kworker.0 Request processed in 51us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638560.481821:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788638560.481836:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788638560.481842:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183650176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638560.481874:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4658380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183650176:12345-0@lo:400:kworker.0 Request processed in 32us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638560.481892:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788638560.481926:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387dbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183650176:0@lo:400:kworker.0 00000100:00080000:0.0:1788638560.481945:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638560.481960:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387dbdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183650048:0@lo:400:kworker.0 00000100:00100000:0.0:1788638560.481970:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387dbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183650432:0@lo:400:kworker.0 00000100:00100000:1.0:1788638560.482414:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638560.482540:0:11999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183650560 00000100:00100000:1.0:1788638560.482545:0:11999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183650560 00000100:00100000:1.0:1788638560.482576:0:11999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183650304 00000100:00100000:1.0:1788638560.482578:0:11999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183650304 00000100:00100000:1.0:1788638560.482594:0:11999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788638560.482600:0:11999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183650560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638560.482636:0:11999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183650560:12345-0@lo:400:kworker.0 Request processed in 37us (1311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638560.482643:0:11999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788638560.482653:0:11999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788638560.482658:0:11999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183650304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638560.482685:0:11999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183650304:12345-0@lo:400:kworker.0 Request processed in 27us (1252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638560.482690:0:11999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00080000:1.0:1788638560.482703:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788638560.482706:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788638560.482724:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387dbc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183650560:0@lo:400:kworker.0 00000100:00100000:1.0:1788638560.482746:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387dbf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183650304:0@lo:400:kworker.0 00000100:00100000:3.0:1788638560.483026:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183649920 00000100:00100000:3.0:1788638560.483031:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183649920 00000100:00100000:3.0:1788638560.483063:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788638560.483199:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183649920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638560.483254:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383681450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3293:x1875523183649920:12345-0@lo:400:kworker.0 Request processed in 185us (2120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638560.483262:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788638560.483301:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387dbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183649920:0@lo:400:kworker.0 00010000:00010000:3.0:1788638560.483368:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b1cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.483378:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b1cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.483386:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b1cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.483392:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638560.483396:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b1cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.483404:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b1cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.483420:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c738a6e9c00) 00010000:00010000:3.0:1788638560.483432:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638560.483439:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b1cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638560.483445:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b1cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638560.483779:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+18:11363:x1875523174203904:12345-192.168.203.34@tcp:101:bash.0 Request processed in 2598us (2998us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788638560.483806:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 143 00000100:00100000:0.0:1788638560.485858:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638560.485915:0:11999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174204032 00000100:00100000:2.0:1788638560.485924:0:11999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174204032 00000100:00100000:2.0:1788638560.485991:0:11999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 47 00000100:00100000:2.0:1788638560.486000:0:11999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2364:x1875523174204032:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:2.0:1788638560.486027:0:11999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638560.486047:0:11999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ad12f1b/0xa0b1f1e3b4b2b1e4 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434ff8 expref: -99 pid: 11999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788638560.486075:0:11999:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788638560.486093:0:11999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=323s v=(0 0) 00010000:00010000:2.0:1788638560.486098:0:11999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788638560.486107:0:11999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ad12f1b/0xa0b1f1e3b4b2b1e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ff8 expref: 6 pid: 11999 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.486129:0:11999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008ad12f1b/0xa0b1f1e3b4b2b1e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ff8 expref: 6 pid: 11999 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.486144:0:11999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7600, rc 0) 00000100:00100000:2.0:1788638560.486204:0:11999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2364:x1875523174204032:12345-192.168.203.34@tcp:101:bash.0 Request processed in 204us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638560.486219:0:11999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 47 00000100:00080000:0.0:1788638560.486301:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788638560.489558:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638560.489718:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174204160 00000100:00100000:0.0:1788638560.489728:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174204160 00000100:00100000:0.0:1788638560.489806:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 48 00000100:00100000:0.0:1788638560.489817:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:11363:x1875523174204160:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:0.0:1788638560.489957:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638560.489977:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f672074/0xa0b1f1e3b4b2b1eb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1434fff expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.490011:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ad12f1b/0xa0b1f1e3b4b2b1e4 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ff8 expref: 7 pid: 11999 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.490020:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638560.490025:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638560.490031:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f672074/0xa0b1f1e3b4b2b1eb lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fff expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.490064:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ad12f1b/0xa0b1f1e3b4b2b1e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ff8 expref: 7 pid: 11999 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.490097:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ad12f1b/0xa0b1f1e3b4b2b1e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ff8 expref: 7 pid: 11999 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638560.490110:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4658a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1875523183650688:192.168.203.34@tcp:104: 00000100:00100000:0.0:1788638560.490189:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398eddd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788638560.492658:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4658a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1875523183650688:192.168.203.34@tcp:104: 00010000:00010000:0.0:1788638560.492696:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005f672074/0xa0b1f1e3b4b2b1eb lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fff expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.492716:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01ce00, rc 0) 00000100:00100000:0.0:1788638560.492766:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+7:11363:x1875523174204160:12345-192.168.203.34@tcp:101:bash.0 Request processed in 2950us (3214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638560.492775:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 48 00000100:00100000:3.0:1788638560.492889:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638560.493288:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174204288 00000100:00100000:2.0:1788638560.493296:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174204288 00010000:00010000:2.0:1788638560.493328:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ad12f1b/0xa0b1f1e3b4b2b1e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ff8 expref: 8 pid: 11999 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638560.493369:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 62 00000100:00100000:2.0:1788638560.493379:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2365:x1875523174204288:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638560.493392:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638560.493436:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ad12f1b/0xa0b1f1e3b4b2b1e4 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ff8 expref: 8 pid: 11999 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.493451:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ad12f1b/0xa0b1f1e3b4b2b1e4 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ff8 expref: 8 pid: 11999 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.493474:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ad12f1b/0xa0b1f1e3b4b2b1e4 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ff8 expref: 8 pid: 11999 timeout: 423 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.493488:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788638560.493493:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788638560.493501:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005f672074/0xa0b1f1e3b4b2b1eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fff expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.493511:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f672074/0xa0b1f1e3b4b2b1eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fff expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.493545:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000005f672074/0xa0b1f1e3b4b2b1eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fff expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638560.493559:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b489b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1875523183650816:192.168.203.34@tcp:105: 00000100:00100000:2.0:1788638560.493629:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387969480 going to sleep for 11 seconds 00000100:00100000:2.0:1788638560.496068:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b489b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1875523183650816:192.168.203.34@tcp:105: 00010000:00010000:2.0:1788638560.496091:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638560.496146:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2365:x1875523174204288:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 2768us (3258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638560.496170:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 62 00000100:00100000:3.0:1788638560.497009:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638560.497080:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174204544 00000100:00100000:1.0:1788638560.497087:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174204544 00000100:00100000:1.0:1788638560.497136:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 36 00000100:00100000:1.0:1788638560.497146:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+18:11363:x1875523174204544:12345-192.168.203.34@tcp:35:bash.0 00000100:00100000:1.0:1788638560.497476:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+19:11363:x1875523174204544:12345-192.168.203.34@tcp:35:bash.0 Request processed in 331us (469us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1788638560.497484:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 36 00000100:00100000:1.0:1788638560.526010:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638560.526076:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638560.526246:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174204672 00000100:00100000:2.0:1788638560.526256:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174204672 00002000:00100000:2.0:1788638560.526308:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9c7387d9d500 x1875523174204672/t0(0) o4->00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp:536/0 lens 504/0 e 0 to 0 dl 1788638571 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788638560.526320:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7387d9d500 with x1875523174204672 ext(0->12) 00002000:00010000:2.0:1788638560.526326:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c7387d9d500 00000100:00100000:2.0:1788638560.526364:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 4 00000100:00100000:2.0:1788638560.526374:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2365:x1875523174204672:12345-192.168.203.34@tcp:4:bash.0 00000100:00100000:3.0:1788638560.526955:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174204800 00000100:00100000:3.0:1788638560.526962:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174204800 00000100:00100000:3.0:1788638560.527004:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 49 00000100:00100000:3.0:1788638560.527012:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2365:x1875523174204800:12345-192.168.203.34@tcp:16:kworker.0 00000100:00100000:3.0:1788638560.527098:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2365:x1875523174204800:12345-192.168.203.34@tcp:16:kworker.0 Request processed in 86us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638560.527105:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 49 00000100:00100000:2.0:1788638560.528020:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2365:x1875523174204672:12345-192.168.203.34@tcp:4:bash.0 Request processed in 1643us (2017us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788638560.528029:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 4 00002000:00100000:2.0:1788638560.528039:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9c7387d9d500 x1875523174204672/t4294967305(0) o4->00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp:536/0 lens 504/448 e 0 to 0 dl 1788638571 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788638560.528047:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7387d9d500 with x1875523174204672 ext(0->12) 00002000:00010000:2.0:1788638560.528052:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9c7387d9d500 00000100:00100000:1.0:1788638560.584462:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638560.584551:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174205056 00000100:00100000:0.0:1788638560.584561:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174205056 00000100:00100000:0.0:1788638560.584626:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 144 00000100:00100000:0.0:1788638560.584635:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+19:11373:x1875523174205056:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638560.584658:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638560.584678:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b1f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435006 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638560.584764:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788638560.584930:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b1f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435006 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.584963:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7398420a00) 00010000:00010000:0.0:1788638560.584967:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788638560.584973:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b1f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435006 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.584987:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01c200, rc 0) 00000100:00100000:0.0:1788638560.585045:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+20:11373:x1875523174205056:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 411us (591us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788638560.585053:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 144 00000100:00100000:3.0:1788638560.587491:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638560.587579:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174205312 00000100:00100000:1.0:1788638560.587587:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174205312 00000100:00100000:1.0:1788638560.587652:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 37 00000100:00100000:1.0:1788638560.587663:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+20:11373:x1875523174205312:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:1.0:1788638560.587908:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+21:11373:x1875523174205312:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 246us (422us total) trans 4294967420 rc 0/0 00000100:00100000:1.0:1788638560.587915:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 37 00000100:00100000:3.0:1788638560.650064:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638560.650185:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174205440 00000100:00100000:0.0:1788638560.650194:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174205440 00000100:00100000:0.0:1788638560.650261:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 145 00000100:00100000:0.0:1788638560.650270:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+21:11379:x1875523174205440:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638560.650292:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638560.650311:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b200 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143500d expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.650522:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b207 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.650537:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.650550:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638560.650585:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788638560.650602:0:7634:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638560.650626:0:7634:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b207 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.650653:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b200 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143500d expref: 23 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.650673:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b207 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143500d expref: 22 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.650681:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:0.0:1788638560.650683:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788638560.650686:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01da00, rc 0) 00000100:00100000:0.0:1788638560.650747:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+22:11379:x1875523174205440:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 478us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638560.650754:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 145 00000100:00100000:2.0:1788638560.656041:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638560.656166:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174205696 00000100:00100000:0.0:1788638560.656185:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174205696 00000100:00100000:0.0:1788638560.656249:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 146 00000100:00100000:0.0:1788638560.656259:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b489b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+22:11379:x1875523174205696:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638560.656278:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638560.656302:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b20e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435014 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.656398:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2b215 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.656412:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2b215 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.656442:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2b215 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638560.656455:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788638560.656582:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b20e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435014 expref: 25 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.656601:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2b215 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435014 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.656610:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c738a6e9e00) 00010000:00010000:0.0:1788638560.656613:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788638560.656616:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01ca00, rc 0) 00000100:00100000:0.0:1788638560.656676:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b489b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+24:11379:x1875523174205696:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 419us (642us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788638560.656684:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 146 00000100:00100000:3.0:1788638560.660098:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638560.660191:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174205952 00000100:00100000:0.0:1788638560.660201:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174205952 00000100:00100000:0.0:1788638560.660273:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 147 00000100:00100000:0.0:1788638560.660283:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+24:11379:x1875523174205952:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638560.660308:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638560.660329:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b223 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143501b expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.660424:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b22a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.660456:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b22a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.660468:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b22a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638560.660482:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788638560.660597:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b223 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143501b expref: 27 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.660615:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b22a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143501b expref: 26 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.660624:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c738a6e9e00) 00010000:00010000:0.0:1788638560.660628:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788638560.660632:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01c600, rc 0) 00000100:00100000:0.0:1788638560.660694:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+26:11379:x1875523174205952:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 412us (605us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1788638560.660701:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 147 00000100:00100000:3.0:1788638560.661825:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638560.661900:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174206080 00000100:00100000:2.0:1788638560.661907:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174206080 00000100:00100000:2.0:1788638560.661964:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 11 00000100:00100000:2.0:1788638560.661974:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+26:2364:x1875523174206080:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638560.661987:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638560.662008:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ca00/0xa0b1f1e3b4b2b215 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435014 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.662043:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c738a6e9e00) 00010000:00010000:2.0:1788638560.662048:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638560.662092:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+25:2364:x1875523174206080:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 118us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638560.662098:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 11 00000100:00100000:1.0:1788638560.665831:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638560.665926:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174206208 00000100:00100000:2.0:1788638560.665940:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174206208 00000100:00100000:2.0:1788638560.666018:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 50 00000100:00100000:2.0:1788638560.666028:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2365:x1875523174206208:12345-192.168.203.34@tcp:1:lfs.0 00010000:00010000:2.0:1788638560.666072:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309d61c4/0xa0b1f1e3b4b2b238 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.666093:0:6684:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f672074/0xa0b1f1e3b4b2b1eb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fff expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.666102:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788638560.666107:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788638560.666114:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309d61c4/0xa0b1f1e3b4b2b238 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.666150:0:6684:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f672074/0xa0b1f1e3b4b2b1eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fff expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.666165:0:6684:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f672074/0xa0b1f1e3b4b2b1eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fff expref: 8 pid: 6687 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638560.666203:0:6684:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b489aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6684:1875523183650944:192.168.203.34@tcp:104: 00000100:00100000:2.0:1788638560.666315:0:6684:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73879693c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638560.668588:0:6684:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b489aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6684:1875523183650944:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638560.668614:0:6684:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000309d61c4/0xa0b1f1e3b4b2b238 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638560.674637:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638560.674700:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174206336 00000100:00100000:2.0:1788638560.674710:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174206336 00010000:00010000:2.0:1788638560.674749:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f672074/0xa0b1f1e3b4b2b1eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fff expref: 9 pid: 6687 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638560.674826:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 63 00000100:00100000:2.0:1788638560.674837:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+9:2365:x1875523174206336:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638560.674854:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788638560.674873:0:5828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788638560.674876:0:5828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788638560 00002000:00010000:2.0:1788638560.674879:0:5828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788638560 00010000:00010000:2.0:1788638560.674885:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f672074/0xa0b1f1e3b4b2b1eb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fff expref: 9 pid: 6687 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.674899:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f672074/0xa0b1f1e3b4b2b1eb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fff expref: 9 pid: 6687 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.674920:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f672074/0xa0b1f1e3b4b2b1eb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fff expref: 9 pid: 6687 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.675080:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788638560.675085:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788638560.675091:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000309d61c4/0xa0b1f1e3b4b2b238 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.675101:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000309d61c4/0xa0b1f1e3b4b2b238 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.675139:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788638560.675166:0:6684:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000309d61c4/0xa0b1f1e3b4b2b238 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.675186:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000309d61c4/0xa0b1f1e3b4b2b238 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638560.675192:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2365:x1875523174206336:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 357us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638560.675199:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 63 00010000:00010000:0.0:1788638560.675217:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000309d61c4/0xa0b1f1e3b4b2b238 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.675239:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000309d61c4/0xa0b1f1e3b4b2b238 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.675248:0:6684:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000309d61c4/0xa0b1f1e3b4b2b238 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.675255:0:6684:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638560.675260:0:6684:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000309d61c4/0xa0b1f1e3b4b2b238 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.675274:0:6684:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000309d61c4/0xa0b1f1e3b4b2b238 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.675286:0:6684:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000309d61c4/0xa0b1f1e3b4b2b238 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.675293:0:6684:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000309d61c4/0xa0b1f1e3b4b2b238 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638560.675343:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2365:x1875523174206208:12345-192.168.203.34@tcp:1:lfs.0 Request processed in 9316us (9562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638560.675351:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 50 00000100:00100000:3.0:1788638560.677937:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638560.678900:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174206592 00000100:00100000:1.0:1788638560.678911:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174206592 00000100:00100000:1.0:1788638560.679157:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 38 00000100:00100000:1.0:1788638560.679178:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73a5714050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+25:11379:x1875523174206592:12345-192.168.203.34@tcp:35:lfs.0 00000004:00010000:1.0:1788638560.679250:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b22a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143501b expref: 25 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788638560.679507:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:1.0:1788638560.679555:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:1.0:1788638560.680474:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:1.0:1788638560.680541:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b23f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.680559:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b1d6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ff1 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.680569:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b23f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.680610:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b1d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ff1 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.680624:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b1d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ff1 expref: 29 pid: 5843 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638560.680638:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387d9fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1875523183651072:192.168.203.34@tcp:104: 00000100:00100000:1.0:1788638560.680767:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788638560.687640:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387d9fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1875523183651072:192.168.203.34@tcp:104: 00010000:00010000:1.0:1788638560.687668:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b23f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638560.688574:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638560.688709:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174206720 00000100:00100000:2.0:1788638560.688718:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174206720 00010000:00010000:2.0:1788638560.688752:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b1d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ff1 expref: 30 pid: 5843 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638560.688827:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 64 00000100:00100000:2.0:1788638560.688838:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384df8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+30:2364:x1875523174206720:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638560.688852:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638560.688859:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b1d6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ff1 expref: 30 pid: 5843 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.688871:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b1d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ff1 expref: 30 pid: 5843 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.688931:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b1d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434ff1 expref: 30 pid: 5843 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.689943:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c738a6e9e00) 00010000:00010000:2.0:1788638560.690023:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b23f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.690034:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b23f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.690041:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b23f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638560.690123:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638560.690198:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384df8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+29:2364:x1875523174206720:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 1360us (1625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638560.690217:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 64 00010000:00010000:1.0:1788638560.692090:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b23f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.692104:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b23f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788638560.692300:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788638560.692505:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1788638560.692619:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387d9fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875523183651200:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788638560.692677:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638560.692775:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788638560.694104:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183651200 00000100:00100000:3.0:1788638560.694114:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183651200 00000100:00100000:3.0:1788638560.694225:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788638560.694236:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875523183651200:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788638560.694346:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5845:x1875523183651200:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 111us (1668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638560.694364:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788638560.694447:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387d9fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875523183651200:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788638560.695001:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788638560.695073:0:5845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4658a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875523183651328:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788638560.695108:0:5845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638560.695810:0:5845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387973000 going to sleep for 11 seconds 00000100:00100000:2.0:1788638560.696110:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183651328 00000100:00100000:2.0:1788638560.696117:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183651328 00000100:00100000:2.0:1788638560.696153:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788638560.696160:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b465b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1875523183651328:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788638560.696452:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b465b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1875523183651328:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 291us (1342us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788638560.696460:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788638560.696550:0:5845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4658a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1875523183651328:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788638560.696607:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1788638560.696647:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b23f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.696658:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b23f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.696666:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b23f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.696672:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638560.696676:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b23f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.696683:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b23f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.696698:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c738a6e9e00) 00010000:00010000:0.0:1788638560.696701:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788638560.696706:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b23f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.696713:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b23f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788638560.697309:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788638560.697414:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1788638560.697440:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 323768656623ns, next at 324768654257ns, rc = 0 00000001:00080000:0.0:1788638560.697448:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788638560.697485:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c738a6e9e00) 00010000:00010000:0.0:1788638560.697489:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788638560.697496:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b22a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143501b expref: 33 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638560.697648:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73a5714050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+32:11379:x1875523174206592:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 18482us (19718us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1788638560.697658:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 38 00000020:00080000:0.0:1788638560.697662:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788638560.700763:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638560.700875:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174206848 00000100:00100000:1.0:1788638560.700884:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174206848 00000100:00100000:1.0:1788638560.700935:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 148 00000100:00100000:1.0:1788638560.700945:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+32:11379:x1875523174206848:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:1.0:1788638560.700981:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638560.701001:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b246 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435022 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.701063:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b246 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435022 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.701078:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b246 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435022 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.701096:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:1.0:1788638560.701099:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788638560.701103:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385308000, rc 0) 00000100:00100000:1.0:1788638560.701157:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+33:11379:x1875523174206848:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 213us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638560.701164:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 148 00000100:00100000:3.0:1788638560.705878:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638560.705977:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174207104 00000100:00100000:0.0:1788638560.705988:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174207104 00000100:00100000:0.0:1788638560.706036:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 39 00000100:00100000:0.0:1788638560.706046:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+33:11379:x1875523174207104:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:0.0:1788638560.706297:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+34:11379:x1875523174207104:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 252us (428us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1788638560.706304:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 39 00000100:00100000:3.0:1788638560.807417:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638560.807749:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174207360 00000100:00100000:0.0:1788638560.807760:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174207360 00000100:00100000:0.0:1788638560.807848:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 149 00000100:00100000:0.0:1788638560.807858:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+34:11389:x1875523174207360:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638560.807880:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638560.807898:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b24d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435029 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638560.807981:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788638560.808109:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b24d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435029 expref: 36 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.808124:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7398420a00) 00010000:00010000:0.0:1788638560.808127:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788638560.808133:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b24d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435029 expref: 36 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.808147:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01c600, rc 0) 00000100:00100000:0.0:1788638560.808219:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+35:11389:x1875523174207360:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 362us (811us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1788638560.808226:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 149 00000100:00100000:2.0:1788638560.814182:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638560.814369:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174207488 00000100:00100000:0.0:1788638560.814379:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174207488 00000100:00100000:0.0:1788638560.814431:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 150 00000100:00100000:0.0:1788638560.814442:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b489aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+35:11389:x1875523174207488:12345-192.168.203.34@tcp:34:lfs.0 00010000:00010000:0.0:1788638560.814515:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b25b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814534:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b25b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814548:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b25b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814564:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b262 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814571:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b262 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814592:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b262 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814674:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b269 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814682:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814689:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788638560.814729:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814741:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b25b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814747:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b25b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814754:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b25b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814759:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01dc00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638560.814763:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b25b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814770:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b25b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814827:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:0.0:1788638560.814838:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638560.814844:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b25b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814850:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b25b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814864:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b262 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814870:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b262 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814875:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b262 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814880:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638560.814882:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b262 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814888:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b262 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814895:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c73a1cf7900) 00010000:00010000:0.0:1788638560.814898:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638560.814901:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b262 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814905:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b262 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814918:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814930:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b269 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814935:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814941:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638560.814945:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814951:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b269 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814959:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:0.0:1788638560.814962:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638560.814964:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b269 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.814969:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b269 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638560.815042:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b489aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+35:11389:x1875523174207488:12345-192.168.203.34@tcp:34:lfs.0 Request processed in 601us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638560.815050:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 150 00000100:00100000:3.0:1788638560.820188:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638560.820364:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174207744 00000100:00100000:0.0:1788638560.820372:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174207744 00000100:00100000:0.0:1788638560.820426:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 40 00000100:00100000:0.0:1788638560.820437:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+35:11389:x1875523174207744:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:0.0:1788638560.820660:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+36:11389:x1875523174207744:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 224us (490us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788638560.820681:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 40 00000100:00100000:3.0:1788638560.870975:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638560.871095:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174208000 00000100:00100000:0.0:1788638560.871106:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174208000 00000100:00100000:0.0:1788638560.871163:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 151 00000100:00100000:0.0:1788638560.871173:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+36:11392:x1875523174208000:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638560.871195:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638560.871228:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b270 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435030 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871308:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b277 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871323:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b277 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871334:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b277 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871348:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b27e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871354:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b27e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871361:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b27e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871477:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b285 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871514:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b285 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871521:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b285 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638560.871532:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788638560.871622:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b277 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871630:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b277 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871637:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b277 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871643:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638560.871658:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b277 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871666:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b277 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871691:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:0.0:1788638560.871693:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638560.871698:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b277 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871704:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b277 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871726:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b27e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871739:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b27e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871744:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b27e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871749:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01dc00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638560.871752:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b27e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871757:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b27e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871765:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c73a1cf7900) 00010000:00010000:0.0:1788638560.871767:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638560.871770:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b27e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871775:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b27e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871874:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b270 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435030 expref: 39 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871887:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b285 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435030 expref: 38 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638560.871893:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:0.0:1788638560.871895:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788638560.871903:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01c600, rc 0) 00000100:00100000:0.0:1788638560.871961:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+38:11392:x1875523174208000:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 789us (995us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788638560.871969:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 151 00000100:00100000:2.0:1788638560.880658:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638560.881003:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174208128 00000100:00100000:1.0:1788638560.881018:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174208128 00000100:00100000:1.0:1788638560.881069:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 152 00000100:00100000:1.0:1788638560.881078:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+38:11392:x1875523174208128:12345-192.168.203.34@tcp:54:lfs.0 00010000:00010000:1.0:1788638560.881136:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b293 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.881152:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.881164:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.881219:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.881227:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b293 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.881234:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b293 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.881240:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638560.881252:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b293 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.881259:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b293 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.881271:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:1.0:1788638560.881274:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788638560.881278:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b293 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638560.881285:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b293 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638560.881355:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4898700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+38:11392:x1875523174208128:12345-192.168.203.34@tcp:54:lfs.0 Request processed in 277us (707us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638560.881363:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 152 00000100:00100000:3.0:1788638560.886718:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638560.886856:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174208384 00000100:00100000:0.0:1788638560.886866:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174208384 00000100:00100000:0.0:1788638560.886915:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 41 00000100:00100000:0.0:1788638560.886926:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+38:11392:x1875523174208384:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:0.0:1788638560.887145:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+39:11392:x1875523174208384:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 218us (434us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788638560.887154:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 41 00000100:00100000:1.0:1788638560.992325:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788638560.992347:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183651456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788638560.992417:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638560.992577:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183651456 00000100:00100000:3.0:1788638560.992585:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183651456 00000100:00100000:3.0:1788638560.992647:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788638560.992657:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183651456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788638560.992847:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788638560.992903:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183651456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 247us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638560.992913:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788638560.993001:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183651456:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788638561.043555:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:1.0:1788638561.043568:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1788638561.061141:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967436 is committed 00000004:00080000:1.0:1788638561.061175:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1788638561.061193:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c7398eddd80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1788638561.061198:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c73b4bddc00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c73a0a956c0 00000020:00080000:1.0:1788638561.061201:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c73b4bdd900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c73bc37e000 00000020:00080000:1.0:1788638561.061256:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1788638561.061423:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:0.0:1788638561.061931:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638561.061951:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183651584:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788638561.062016:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638561.062172:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183651584 00000100:00100000:3.0:1788638561.062180:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183651584 00000100:00100000:3.0:1788638561.062240:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788638561.062250:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b465bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183651584:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788638561.062277:0:6686:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1788638561.062308:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c7560, atime: 0x0, ctime: 0x6a9c7560, blocks: 0xb 00010000:00010000:3.0:1788638561.062316:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012b694cb/0xa0b1f1e3b4b2b29a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638561.062332:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=324s v=(0 0) 00010000:00010000:3.0:1788638561.062337:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788638561.062356:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012b694cb/0xa0b1f1e3b4b2b29a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638561.062374:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012b694cb/0xa0b1f1e3b4b2b29a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638561.062385:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012b694cb/0xa0b1f1e3b4b2b29a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638561.062393:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012b694cb/0xa0b1f1e3b4b2b29a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638561.062452:0:6686:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788638561.063394:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b465bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3291:x1875523183651584:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1143us (1375us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788638561.063404:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:2.0:1788638561.064922:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638561.064946:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012b694cb/0xa0b1f1e3b4b2b29a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638561.064959:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638561.064964:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012b694cb/0xa0b1f1e3b4b2b29a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638561.064975:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012b694cb/0xa0b1f1e3b4b2b29a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638561.064996:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012b694cb/0xa0b1f1e3b4b2b29a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638561.065004:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012b694cb/0xa0b1f1e3b4b2b29a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638561.065027:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638561.065030:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638561.065031:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638561.065105:0:3291:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1788638561.065111:0:3291:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1788638561.065135:0:3291:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c73acdca300 x1875523183651584/t4294967307(4294967307) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788638577 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788638561.065147:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c73acdca300/2, rc 0, transno 4294967307 00000100:00100000:0.0:1788638561.065153:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183651584:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788638561.180684:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638561.180752:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174208640 00000100:00100000:2.0:1788638561.180762:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174208640 00000100:00100000:2.0:1788638561.180854:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 153 00000100:00100000:2.0:1788638561.180866:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+17:11423:x1875523174208640:12345-192.168.203.34@tcp:101:cat.0 00010000:00010000:2.0:1788638561.180889:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638561.180910:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b2a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435037 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638561.181009:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b2a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638561.181037:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b2a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638561.181051:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b2a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638561.181064:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788638561.181665:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b2a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435037 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638561.181684:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b2a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435037 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638561.181693:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:2.0:1788638561.181696:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788638561.181700:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6a00, rc 0) 00000100:00100000:2.0:1788638561.181768:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+19:11423:x1875523174208640:12345-192.168.203.34@tcp:101:cat.0 Request processed in 904us (1093us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1788638561.181776:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 153 00010000:00010000:1.0:1788638561.184079:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638561.190885:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638561.190984:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174208768 00000100:00100000:0.0:1788638561.190993:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174208768 00000100:00100000:0.0:1788638561.191057:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00100000:0.0:1788638561.191067:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4899c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+19:2365:x1875523174208768:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788638561.191082:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638561.191104:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b2a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435037 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.191140:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:0.0:1788638561.191146:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638561.191212:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4899c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+18:2365:x1875523174208768:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 137us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638561.191219:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00100000:3.0:1788638561.194675:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638561.194734:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174209024 00000100:00100000:0.0:1788638561.194745:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174209024 00000100:00100000:0.0:1788638561.194830:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 42 00000100:00100000:0.0:1788638561.194840:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+18:11423:x1875523174209024:12345-192.168.203.34@tcp:35:cat.0 00000100:00100000:0.0:1788638561.195077:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+19:11423:x1875523174209024:12345-192.168.203.34@tcp:35:cat.0 Request processed in 238us (410us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1788638561.195085:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 42 00000100:00100000:3.0:1788638561.264247:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638561.264378:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174209280 00000100:00100000:1.0:1788638561.264388:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174209280 00000100:00100000:1.0:1788638561.264616:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 154 00000100:00100000:1.0:1788638561.264628:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+19:11429:x1875523174209280:12345-192.168.203.34@tcp:101:dd.0 00010000:00010000:1.0:1788638561.264651:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638561.264655:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788638561.264682:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b207 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143500d expref: 19 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.264701:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:1.0:1788638561.264706:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788638561.264720:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b2b6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143503e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.264862:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b2bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.264891:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b285 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435030 expref: 19 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.264899:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b2bd lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.264932:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b285 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435030 expref: 19 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.264946:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b285 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435030 expref: 19 pid: 7634 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638561.264958:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387d9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875523183651712:192.168.203.34@tcp:104: 00000100:00100000:1.0:1788638561.265055:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1788638561.267308:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638561.267405:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387d9fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875523183651712:192.168.203.34@tcp:104: 00010000:00010000:1.0:1788638561.267439:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b2bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638561.267589:0:11689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174209408 00000100:00100000:0.0:1788638561.267596:0:11689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174209408 00010000:00010000:0.0:1788638561.267629:0:11689:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b285 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435030 expref: 20 pid: 7634 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638561.267667:0:11689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 65 00000100:00100000:0.0:1788638561.267676:0:11689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+20:2365:x1875523174209408:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788638561.267689:0:11689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638561.267695:0:11689:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b285 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435030 expref: 20 pid: 7634 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.267707:0:11689:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b285 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435030 expref: 20 pid: 7634 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.267747:0:11689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b285 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435030 expref: 20 pid: 7634 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.267763:0:11689:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:0.0:1788638561.267767:0:11689:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b2bd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.267776:0:11689:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b2bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.267888:0:11689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b2bd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.267909:0:11689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638561.267956:0:11689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+19:2365:x1875523174209408:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 280us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638561.267963:0:11689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 65 00010000:00010000:1.0:1788638561.268151:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b2bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.268159:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b2bd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788638561.268178:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788638561.268331:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b2b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143503e expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.268358:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b2bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143503e expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.268366:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:1.0:1788638561.268369:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788638561.268371:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385308a00, rc 0) 00000100:00100000:1.0:1788638561.268915:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282fff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+19:11429:x1875523174209280:12345-192.168.203.34@tcp:101:dd.0 Request processed in 4288us (4675us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1788638561.268924:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 154 00000100:00100000:3.0:1788638561.273380:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638561.273470:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174209664 00000100:00100000:2.0:1788638561.273481:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174209664 00000100:00100000:2.0:1788638561.273571:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 155 00000100:00100000:2.0:1788638561.273581:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+19:11429:x1875523174209664:12345-192.168.203.34@tcp:36:dd.0 00010000:00010000:2.0:1788638561.273882:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b2cb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638561.273899:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b2cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638561.273919:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b2cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788638561.273971:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1788638561.273997:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f436043 reply state 000000009ac8f09f transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b2cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638561.274006:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788638561.274083:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+22:11429:x1875523174209664:12345-192.168.203.34@tcp:36:dd.0 Request processed in 504us (711us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1788638561.274090:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 155 00000020:00080000:2.0:1788638561.274095:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788638561.275741:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b2cb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.275754:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b2cb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.275760:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b2cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.275766:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638561.275769:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b2cb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.275776:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b2cb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.275815:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:1.0:1788638561.275818:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638561.275823:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b2cb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.275842:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b2cb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638561.579975:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638561.580458:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174209792 00000100:00100000:0.0:1788638561.580468:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174209792 00000100:00100000:0.0:1788638561.580527:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 156 00000100:00100000:0.0:1788638561.580536:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+21:11443:x1875523174209792:12345-192.168.203.34@tcp:101:stat.0 00010000:00010000:0.0:1788638561.580559:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638561.580578:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b2d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435045 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.580638:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b2d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.580667:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b2d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.580679:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b2d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.580695:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b2e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.580702:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b2e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.580709:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b2e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.581019:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b2e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.581160:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b2bd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143503e expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.581244:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b2e7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.581279:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b2bd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143503e expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.581293:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b2bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143503e expref: 22 pid: 5842 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638561.581319:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4658a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875523183651840:192.168.203.34@tcp:104: 00000100:00100000:0.0:1788638561.581463:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7d8be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788638561.592132:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638561.592240:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174210048 00000100:00100000:3.0:1788638561.592251:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174210048 00000100:00100000:3.0:1788638561.592307:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 43 00000100:00100000:3.0:1788638561.592317:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+23:9975:x1875523174210048:12345-192.168.203.34@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788638561.592663:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+24:9975:x1875523174210048:12345-192.168.203.34@tcp:35:ldlm_bl.0 Request processed in 346us (539us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788638561.592682:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 43 00000100:00100000:2.0:1788638561.594963:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638561.595058:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174210176 00000100:00100000:1.0:1788638561.595068:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174210176 00010000:00010000:1.0:1788638561.595102:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b2bd lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143503e expref: 24 pid: 5842 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638561.595143:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 66 00000100:00100000:1.0:1788638561.595153:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4898e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+24:2365:x1875523174210176:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638561.595178:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638561.595185:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b2bd lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143503e expref: 24 pid: 5842 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.595210:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b2bd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143503e expref: 24 pid: 5842 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.595232:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:1.0:1788638561.595238:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b2e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.595249:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.595256:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b2e7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.595276:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638561.595339:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4898e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+24:2365:x1875523174210176:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 187us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638561.595347:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 66 00010000:00010000:0.0:1788638561.599118:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b2bd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143503e expref: 23 pid: 5842 timeout: 424 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638561.599145:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4658a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875523183651840:192.168.203.34@tcp:104: 00010000:00010000:0.0:1788638561.599181:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.599191:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.599198:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638561.599258:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788638561.599262:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638561.599286:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.599303:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b2e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.599314:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b2d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.599320:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b2d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.599349:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b2d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.599355:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638561.599360:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b2d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.599367:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b2d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.599382:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:0.0:1788638561.599386:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638561.599392:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b2d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.599399:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b2d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.599411:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b2e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.599417:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b2e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.599434:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b2e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.599440:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01dc00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638561.599443:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b2e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.599461:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b2e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.599470:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c73a1cf7900) 00010000:00010000:0.0:1788638561.599472:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638561.599475:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b2e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.599481:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b2e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.599530:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b2d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435045 expref: 23 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.599544:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b2e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435045 expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.599551:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:0.0:1788638561.599552:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788638561.599554:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01c200, rc 0) 00000100:00100000:0.0:1788638561.599632:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+22:11443:x1875523174209792:12345-192.168.203.34@tcp:101:stat.0 Request processed in 19096us (19665us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638561.599642:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 156 00000100:00100000:2.0:1788638561.706463:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638561.706557:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174210432 00000100:00100000:0.0:1788638561.706568:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174210432 00000100:00100000:0.0:1788638561.706632:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 157 00000100:00100000:0.0:1788638561.706642:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+22:11449:x1875523174210432:12345-192.168.203.34@tcp:36:truncate.0 00010000:00010000:0.0:1788638561.706714:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638561.706753:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b2e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435045 expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.706772:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:0.0:1788638561.706778:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788638561.707340:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b2ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.707355:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b2ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638561.707366:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b2ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788638561.707409:0:7634:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1788638561.707428:0:7634:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bec19401 reply state 000000003951b666 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b2ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638561.707437:0:7634:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788638561.707571:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4898000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+24:11449:x1875523174210432:12345-192.168.203.34@tcp:36:truncate.0 Request processed in 930us (1114us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1788638561.707579:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 157 00000020:00080000:0.0:1788638561.707584:0:7634:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788638561.714276:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b2ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638561.714293:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b2ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638561.714301:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b2ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638561.714307:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638561.714313:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b2ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638561.714321:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b2ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638561.714347:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:3.0:1788638561.714351:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638561.714356:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b2ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638561.714363:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b2ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638561.931840:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638561.931997:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174210560 00000100:00100000:1.0:1788638561.932007:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174210560 00000100:00100000:1.0:1788638561.932063:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 158 00000100:00100000:1.0:1788638561.932073:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+23:11462:x1875523174210560:12345-192.168.203.34@tcp:101:stat.0 00010000:00010000:1.0:1788638561.932095:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638561.932115:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b2f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143504c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932189:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b2fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932213:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b2fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932227:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b2fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932243:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b303 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932252:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b303 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932259:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b303 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932555:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b30a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932575:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b30a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932583:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b30a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788638561.932617:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1788638561.932621:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788638561.932644:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b30a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932656:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b30a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932664:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b2fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932670:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b2fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932686:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b2fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932692:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638561.932697:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b2fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932705:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b2fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932716:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:1.0:1788638561.932725:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638561.932730:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b2fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932737:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b2fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932750:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b303 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932757:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b303 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932763:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b303 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932768:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638561.932771:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b303 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932776:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b303 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932823:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c7398420d00) 00010000:00010000:1.0:1788638561.932826:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638561.932829:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b303 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932835:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b303 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932866:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b2f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143504c expref: 25 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932891:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b30a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143504c expref: 24 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638561.932898:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:1.0:1788638561.932900:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788638561.932903:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385308a00, rc 0) 00000100:00100000:1.0:1788638561.932964:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+24:11462:x1875523174210560:12345-192.168.203.34@tcp:101:stat.0 Request processed in 892us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638561.932971:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 158 00000100:00100000:1.0:1788638562.050361:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638562.050451:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174210816 00000100:00100000:0.0:1788638562.050461:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174210816 00000100:00100000:0.0:1788638562.050541:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 159 00000100:00100000:0.0:1788638562.050551:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+24:11473:x1875523174210816:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638562.050572:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638562.050608:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b311 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435053 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638562.050706:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788638562.050868:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b311 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435053 expref: 26 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.050883:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7398420a00) 00010000:00010000:0.0:1788638562.050886:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788638562.050892:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b311 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435053 expref: 26 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.050906:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01dc00, rc 0) 00000100:00100000:0.0:1788638562.050969:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+25:11473:x1875523174210816:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 418us (616us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1788638562.050976:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 159 00000100:00080000:1.0:1788638562.051475:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638562.054721:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638562.054813:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174211072 00000100:00100000:3.0:1788638562.054822:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174211072 00000100:00100000:3.0:1788638562.054882:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 44 00000100:00100000:3.0:1788638562.054892:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73a5715050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+25:11473:x1875523174211072:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:3.0:1788638562.055135:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73a5715050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+26:11473:x1875523174211072:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 244us (423us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788638562.055143:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 44 00000100:00100000:3.0:1788638562.133365:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638562.133469:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174211328 00000100:00100000:0.0:1788638562.133479:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174211328 00000100:00100000:0.0:1788638562.133540:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 160 00000100:00100000:0.0:1788638562.133551:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+26:11480:x1875523174211328:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:0.0:1788638562.133574:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638562.133595:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b31f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143505a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.133693:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b326 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.133723:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b30a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143504c expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.133739:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b326 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.133771:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b30a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143504c expref: 27 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.133953:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b30a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143504c expref: 27 pid: 5842 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638562.133969:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4658a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875523183651968:192.168.203.34@tcp:104: 00000100:00100000:0.0:1788638562.134077:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7d8bc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788638562.136638:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4658a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875523183651968:192.168.203.34@tcp:104: 00010000:00010000:0.0:1788638562.136666:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b326 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638562.137035:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638562.137247:0:11689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174211456 00000100:00100000:0.0:1788638562.137254:0:11689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174211456 00010000:00010000:0.0:1788638562.137290:0:11689:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b30a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143504c expref: 28 pid: 5842 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638562.137333:0:11689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 67 00000100:00100000:0.0:1788638562.137343:0:11689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+28:2365:x1875523174211456:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788638562.137358:0:11689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638562.137379:0:11689:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b30a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143504c expref: 28 pid: 5842 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.137392:0:11689:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b30a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143504c expref: 28 pid: 5842 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.137413:0:11689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b30a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143504c expref: 28 pid: 5842 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.137430:0:11689:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:0.0:1788638562.137435:0:11689:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b326 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.137444:0:11689:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b326 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.137452:0:11689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b326 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.137649:0:11689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638562.137707:0:11689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+27:2365:x1875523174211456:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 365us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638562.137715:0:11689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 67 00010000:00010000:1.0:1788638562.140274:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b326 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.140292:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b326 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788638562.140316:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1788638562.140485:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b31f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143505a expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.141042:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b326 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143505a expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.141054:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:1.0:1788638562.141056:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788638562.141060:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01d000, rc 0) 00000100:00100000:1.0:1788638562.141368:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+27:11480:x1875523174211328:12345-192.168.203.34@tcp:101:bash.0 Request processed in 7817us (8010us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1788638562.141378:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 160 00000100:00100000:3.0:1788638562.146146:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638562.146307:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174211712 00000100:00100000:1.0:1788638562.146318:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174211712 00000100:00100000:1.0:1788638562.146373:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 161 00000100:00100000:1.0:1788638562.146384:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+27:11480:x1875523174211712:12345-192.168.203.34@tcp:36:bash.0 00010000:00010000:1.0:1788638562.146665:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b334 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.146683:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.146697:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788638562.146752:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:1.0:1788638562.149045:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000564c32c5 reply state 00000000fb3de1b1 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638562.149062:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788638562.151405:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+30:11480:x1875523174211712:12345-192.168.203.34@tcp:36:bash.0 Request processed in 5012us (5258us total) trans 4294967449 rc 0/0 00000100:00100000:1.0:1788638562.151418:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 161 00000020:00080000:1.0:1788638562.151425:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788638562.156473:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b334 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.156493:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b334 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.156522:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b334 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.156528:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638562.156532:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b334 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.156540:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b334 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.156556:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:1.0:1788638562.156559:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638562.156564:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b334 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.156571:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b334 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638562.159612:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638562.159701:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174211840 00000100:00100000:1.0:1788638562.159711:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174211840 00000100:00100000:1.0:1788638562.159779:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 162 00000100:00100000:1.0:1788638562.159907:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+29:11480:x1875523174211840:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:1.0:1788638562.159933:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638562.159953:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b33b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435061 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.160036:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b342 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.160050:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b326 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143505a expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.160073:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b342 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.160109:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b326 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143505a expref: 30 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.160124:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b326 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143505a expref: 30 pid: 5844 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638562.160138:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4f24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875523183652096:192.168.203.34@tcp:104: 00000100:00100000:1.0:1788638562.160288:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304a000 going to sleep for 11 seconds 00000100:00100000:3.0:1788638562.163483:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638562.163608:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174211968 00000100:00100000:0.0:1788638562.163617:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174211968 00010000:00010000:0.0:1788638562.163656:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b326 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143505a expref: 31 pid: 5844 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638562.163699:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 68 00000100:00100000:0.0:1788638562.163722:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+31:2365:x1875523174211968:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788638562.163737:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638562.163744:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b326 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143505a expref: 31 pid: 5844 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.163759:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b326 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143505a expref: 31 pid: 5844 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.163828:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:0.0:1788638562.163834:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b342 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.163845:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.163853:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b342 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.163871:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638562.163928:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+31:2365:x1875523174211968:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 208us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638562.163936:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 68 00010000:00010000:1.0:1788638562.165476:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b326 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143505a expref: 30 pid: 5844 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638562.165498:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4f24e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875523183652096:192.168.203.34@tcp:104: 00010000:00010000:1.0:1788638562.165520:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.165530:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.165537:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788638562.165584:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788638562.165589:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788638562.165610:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.165661:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b33b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435061 expref: 30 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.165677:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b342 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435061 expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.165684:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:1.0:1788638562.165687:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788638562.165690:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309e00, rc 0) 00000100:00100000:1.0:1788638562.165747:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4658a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+29:11480:x1875523174211840:12345-192.168.203.34@tcp:101:bash.0 Request processed in 5844us (6144us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638562.165756:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 162 00000100:00100000:3.0:1788638562.169395:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638562.169483:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174212224 00000100:00100000:0.0:1788638562.169492:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174212224 00000100:00100000:0.0:1788638562.169548:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 45 00000100:00100000:0.0:1788638562.169557:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+29:11480:x1875523174212224:12345-192.168.203.34@tcp:35:bash.0 00000100:00100000:0.0:1788638562.169938:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdcb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+30:11480:x1875523174212224:12345-192.168.203.34@tcp:35:bash.0 Request processed in 379us (549us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1788638562.169962:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 45 00010000:00010000:2.0:1788638562.208103:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638562.287527:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638562.287733:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174212480 00000100:00100000:0.0:1788638562.287744:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174212480 00000100:00100000:0.0:1788638562.287848:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 163 00000100:00100000:0.0:1788638562.287858:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+30:11490:x1875523174212480:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638562.287882:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638562.287901:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b349 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435068 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638562.287983:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788638562.288093:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b349 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435068 expref: 32 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.288107:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7398420a00) 00010000:00010000:0.0:1788638562.288111:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788638562.288116:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b349 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435068 expref: 32 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.288130:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01d200, rc 0) 00000100:00100000:0.0:1788638562.288203:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+31:11490:x1875523174212480:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 338us (676us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1788638562.288211:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 163 00000100:00100000:3.0:1788638562.295971:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638562.296180:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174212608 00000100:00100000:0.0:1788638562.296190:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174212608 00000100:00100000:0.0:1788638562.296259:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 164 00000100:00100000:0.0:1788638562.296269:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+31:11490:x1875523174212608:12345-192.168.203.34@tcp:34:lfs.0 00010000:00010000:0.0:1788638562.296358:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b357 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.296376:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b357 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.296389:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b357 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.296403:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b35e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.296411:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b35e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.296418:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b35e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.296697:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b365 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.296709:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.296716:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788638562.296757:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.296770:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b357 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.297056:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b357 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.297062:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b357 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.297068:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638562.297073:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b357 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.297080:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b357 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.297091:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:0.0:1788638562.297094:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638562.297098:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b357 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.297104:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b357 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.297116:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b35e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.297122:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b35e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.297128:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b35e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.297132:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638562.297142:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b35e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.297149:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b35e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.297156:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c73a1cf7900) 00010000:00010000:0.0:1788638562.297159:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638562.297162:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b35e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.297167:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b35e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.297181:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.297187:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b365 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.297192:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b365 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.297208:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01dc00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638562.297211:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b365 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.297217:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b365 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.297224:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:0.0:1788638562.297227:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638562.297235:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b365 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.297242:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b365 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638562.297319:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+31:11490:x1875523174212608:12345-192.168.203.34@tcp:34:lfs.0 Request processed in 1049us (1356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638562.297327:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 164 00000100:00100000:3.0:1788638562.300587:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638562.300724:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174212864 00000100:00100000:0.0:1788638562.300733:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174212864 00000100:00100000:0.0:1788638562.300830:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 46 00000100:00100000:0.0:1788638562.300841:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+31:11490:x1875523174212864:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:0.0:1788638562.301048:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+32:11490:x1875523174212864:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 209us (470us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788638562.301056:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 46 00000100:00100000:3.0:1788638562.354912:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638562.355107:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174213120 00000100:00100000:0.0:1788638562.355117:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174213120 00000100:00100000:0.0:1788638562.355183:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 165 00000100:00100000:0.0:1788638562.355192:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+32:11493:x1875523174213120:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638562.355336:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638562.355358:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b36c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143506f expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.355656:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b373 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.355672:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b373 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.355702:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b373 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.355718:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b37a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.355725:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b37a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.355732:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b37a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.356987:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b381 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.357001:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.357011:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638562.357022:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788638562.357112:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b373 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.357120:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b373 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.357126:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b373 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.357132:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638562.357145:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b373 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.357153:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b373 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.357304:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:0.0:1788638562.357307:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638562.357313:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b373 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.357319:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b373 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.357335:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b37a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.357341:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b37a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.357346:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b37a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.357351:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638562.357354:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b37a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.357360:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b37a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.357368:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c73a1cf7900) 00010000:00010000:0.0:1788638562.357370:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638562.357380:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b37a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.357387:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b37a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.357572:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b36c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143506f expref: 35 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.357589:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b381 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143506f expref: 34 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.357596:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:0.0:1788638562.357598:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788638562.357601:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01c200, rc 0) 00000100:00100000:0.0:1788638562.357731:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+34:11493:x1875523174213120:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 2539us (2828us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788638562.357741:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 165 00000100:00100000:3.0:1788638562.363099:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638562.363203:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174213248 00000100:00100000:1.0:1788638562.363212:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174213248 00000100:00100000:1.0:1788638562.363271:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 166 00000100:00100000:1.0:1788638562.363280:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+34:11493:x1875523174213248:12345-192.168.203.34@tcp:54:lfs.0 00010000:00010000:1.0:1788638562.363344:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b38f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.363359:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b38f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.363371:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b38f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.363397:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b38f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.363421:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b38f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.363428:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b38f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.363433:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638562.363438:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b38f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.363445:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b38f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.363457:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:1.0:1788638562.363460:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788638562.363464:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b38f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.363471:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b38f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638562.363556:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+34:11493:x1875523174213248:12345-192.168.203.34@tcp:54:lfs.0 Request processed in 276us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638562.363564:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 166 00000100:00100000:3.0:1788638562.366586:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638562.368715:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638562.368935:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174213632 00000100:00100000:2.0:1788638562.368945:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174213632 00000100:00100000:2.0:1788638562.369009:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:2.0:1788638562.369020:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+34:2364:x1875523174213632:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638562.369034:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638562.369057:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b381 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143506f expref: 34 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638562.369075:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:2.0:1788638562.369080:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638562.369138:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+33:2364:x1875523174213632:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 120us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638562.369170:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:0.0:1788638562.371373:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174213504 00000100:00100000:0.0:1788638562.371388:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174213504 00000100:00100000:0.0:1788638562.371578:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 47 00000100:00100000:0.0:1788638562.371590:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+33:11493:x1875523174213504:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:0.0:1788638562.371886:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+34:11493:x1875523174213504:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 297us (5307us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1788638562.371894:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 47 00000100:00100000:3.0:1788638562.563880:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638562.564330:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174213888 00000100:00100000:1.0:1788638562.564340:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174213888 00000100:00100000:1.0:1788638562.564393:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 167 00000100:00100000:1.0:1788638562.564402:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+34:11511:x1875523174213888:12345-192.168.203.34@tcp:101:cat.0 00010000:00010000:1.0:1788638562.568469:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638562.568523:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b396 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435076 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.568640:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b39d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.568656:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b39d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.568668:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b39d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788638562.568678:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788638562.568829:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b396 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435076 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.568847:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b39d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435076 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.568855:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:1.0:1788638562.568858:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788638562.568861:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309000, rc 0) 00000100:00100000:1.0:1788638562.568939:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+36:11511:x1875523174213888:12345-192.168.203.34@tcp:101:cat.0 Request processed in 4537us (5068us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788638562.568948:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 167 00000100:00100000:3.0:1788638562.599416:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638562.599533:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174214016 00000100:00100000:1.0:1788638562.599543:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174214016 00000100:00100000:1.0:1788638562.599601:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 168 00000100:00100000:1.0:1788638562.599611:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+36:11512:x1875523174214016:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:1.0:1788638562.599650:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638562.599670:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b3ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143507d expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.599733:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b3b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.599749:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.599760:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788638562.599836:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788638562.599840:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788638562.599855:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b3b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.599881:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b3ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143507d expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.599900:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b3b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143507d expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638562.599908:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:1.0:1788638562.599911:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788638562.599914:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309800, rc 0) 00000100:00100000:1.0:1788638562.599970:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+37:11512:x1875523174214016:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 361us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638562.599977:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 168 00000100:00100000:3.0:1788638562.605030:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638562.605643:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174214400 00000100:00100000:2.0:1788638562.605653:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174214400 00000100:00100000:2.0:1788638562.605714:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 48 00000100:00100000:2.0:1788638562.605724:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+37:11512:x1875523174214400:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:2.0:1788638562.606244:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+38:11512:x1875523174214400:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 518us (1220us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788638562.606252:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 48 00000100:00100000:3.0:1788638562.614816:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638562.615416:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174214528 00000100:00100000:0.0:1788638562.615426:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174214528 00000100:00100000:0.0:1788638562.615511:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 14 00000100:00100000:0.0:1788638562.615522:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+38:11512:x1875523174214528:12345-192.168.203.34@tcp:103:lfs.0 00010000:00010000:0.0:1788638562.615549:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788638562.615574:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b342 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435061 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.615596:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b39d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435076 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.615608:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b246 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435022 expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.615619:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420b00) 00010000:00010000:0.0:1788638562.615630:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638562.615905:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+35:11512:x1875523174214528:12345-192.168.203.34@tcp:103:lfs.0 Request processed in 376us (1125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638562.615914:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 14 00000100:00100000:3.0:1788638562.618481:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638562.618547:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174214656 00000100:00100000:0.0:1788638562.618557:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174214656 00000100:00100000:0.0:1788638562.618617:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 169 00000100:00100000:0.0:1788638562.618626:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+35:11512:x1875523174214656:12345-192.168.203.34@tcp:58:lfs.0 00010000:00010000:0.0:1788638562.618745:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b3b9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.618761:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b3b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.618804:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b3b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788638562.619606:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788638562.619878:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+35:11512:x1875523174214656:12345-192.168.203.34@tcp:58:lfs.0 Request processed in 1249us (1403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638562.619888:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 169 00000100:00100000:3.0:1788638562.650853:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638562.650957:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174214784 00000100:00100000:0.0:1788638562.650967:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174214784 00000100:00100000:0.0:1788638562.651025:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 170 00000100:00100000:0.0:1788638562.651035:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+35:11514:x1875523174214784:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638562.651064:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638562.651086:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b3c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435084 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651152:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b3c7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651176:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b3c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651188:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b3c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651212:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b3ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651220:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b3ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651227:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b3ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651539:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b3d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651549:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651556:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638562.651593:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788638562.651597:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638562.651620:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651632:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b3d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651640:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b3c7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651646:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b3c7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651651:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b3c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651656:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638562.651660:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b3c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651667:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b3c7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651687:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:0.0:1788638562.651691:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638562.651696:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b3c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651702:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b3c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651715:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b3ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651721:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b3ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651726:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b3ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651731:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638562.651734:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b3ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651740:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b3ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651747:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c73a1cf7f00) 00010000:00010000:0.0:1788638562.651749:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638562.651751:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b3ce lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651757:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b3ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651847:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b3c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435084 expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651861:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b3d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435084 expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638562.651867:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c73a1cf7900) 00010000:00010000:0.0:1788638562.651870:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788638562.651872:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01da00, rc 0) 00000100:00100000:0.0:1788638562.651943:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+36:11514:x1875523174214784:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 909us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638562.651951:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 170 00010000:00010000:2.0:1788638563.241957:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788638563.412208:0:12433:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788638563.412219:0:12433:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788638563.412268:0:12433:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1788638563.412274:0:12433:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788638563.424960:0:11706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788638563.424968:0:11706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788638563.425001:0:11706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:3.0:1788638563.425007:0:11706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788638563.425122:0:11706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11706:1875523183652224:192.168.203.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788638563.425227:0:11706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73985813c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638563.432811:0:11706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39fb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11706:1875523183652224:192.168.203.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788638563.435831:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638563.436642:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174214912 00000100:00100000:2.0:1788638563.436653:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174214912 00000100:00100000:2.0:1788638563.436712:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 171 00000100:00100000:2.0:1788638563.436721:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+36:11525:x1875523174214912:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788638563.436750:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788638563.436870:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+36:11525:x1875523174214912:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 Request processed in 149us (1048us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638563.436878:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 171 00000100:00100000:0.0:1788638563.459710:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638563.459756:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174215040 00000100:00100000:0.0:1788638563.459775:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174215040 00000100:00100000:0.0:1788638563.459840:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 172 00000100:00100000:0.0:1788638563.459850:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+36:11525:x1875523174215040:12345-192.168.203.34@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788638563.459923:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b3dc lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.459942:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b3dc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.459967:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b3dc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.459984:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b3e3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.459992:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.459999:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460026:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b3ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460034:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b3ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460041:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b3ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638563.460079:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788638563.460083:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638563.460095:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b3ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460106:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b3dc lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460114:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b3dc lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460132:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b3dc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460138:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01ce00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638563.460142:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b3dc lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460151:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b3dc lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460164:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c73a1cf7600) 00010000:00010000:0.0:1788638563.460168:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638563.460172:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b3dc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460180:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b3dc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460208:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460215:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b3e3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460220:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b3e3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460225:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638563.460228:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b3e3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460243:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b3e3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460252:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9c73a1cf7f00) 00010000:00010000:0.0:1788638563.460254:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638563.460257:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b3e3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460263:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b3e3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460278:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b3ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460283:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b3ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460290:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b3ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460295:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638563.460297:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b3ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460303:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b3ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460310:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c73a1cf7900) 00010000:00010000:0.0:1788638563.460312:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638563.460315:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b3ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.460330:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b3ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638563.460396:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+36:11525:x1875523174215040:12345-192.168.203.34@tcp:34:lhsmtool_posix.0 Request processed in 547us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638563.460404:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 172 00000100:00100000:3.0:1788638563.465958:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638563.466103:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174215296 00000100:00100000:0.0:1788638563.466112:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174215296 00000100:00100000:0.0:1788638563.466180:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 173 00000100:00100000:0.0:1788638563.466199:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+36:11525:x1875523174215296:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788638563.466219:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638563.466239:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b3f1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143508b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.466331:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b3f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.466345:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.466356:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638563.466367:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788638563.466472:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b3f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.466480:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b3f8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.466504:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b3f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.466510:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638563.466514:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b3f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.466522:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b3f8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.466534:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c73a1cf7900) 00010000:00010000:0.0:1788638563.466537:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788638563.466541:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b3f8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.466548:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b3f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.466588:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b3f1 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143508b expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.466599:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c73a1cf7600) 00010000:00010000:0.0:1788638563.466601:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788638563.466605:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b3f1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143508b expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.466614:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01d200, rc 0) 00000100:00100000:0.0:1788638563.466670:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+37:11525:x1875523174215296:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 481us (721us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1788638563.466686:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 173 00000100:00100000:1.0:1788638563.476343:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638563.476508:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174215424 00000100:00100000:3.0:1788638563.476519:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174215424 00000100:00100000:3.0:1788638563.476574:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 174 00000100:00100000:3.0:1788638563.476583:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+37:11525:x1875523174215424:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788638563.476617:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788638563.476706:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f24e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+37:11525:x1875523174215424:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 Request processed in 124us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638563.476714:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 174 00000100:00100000:1.0:1788638563.478759:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638563.478866:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174215680 00000100:00100000:3.0:1788638563.478874:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174215680 00000100:00100000:3.0:1788638563.478924:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 175 00000100:00100000:3.0:1788638563.478934:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+37:11525:x1875523174215680:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788638563.478950:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638563.478953:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788638563.478977:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b3b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143507d expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.478994:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:3.0:1788638563.478999:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788638563.479010:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b406 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435092 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788638563.479640:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788638563.479916:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b40d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.479937:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b40d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.479948:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b40d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.480010:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b406 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435092 expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.480027:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b40d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435092 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.480035:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c7393e81300) 00010000:00010000:3.0:1788638563.480037:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788638563.480041:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030e00, rc 0) 00000100:00100000:3.0:1788638563.480093:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f26680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+38:11525:x1875523174215680:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 1160us (1340us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788638563.480100:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 175 00000100:00100000:3.0:1788638563.497468:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638563.497541:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174215936 00000100:00100000:0.0:1788638563.497549:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174215936 00000100:00100000:0.0:1788638563.497607:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 176 00000100:00100000:0.0:1788638563.497617:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+38:11525:x1875523174215936:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788638563.497671:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638563.497696:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b40d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435092 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.497714:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c7393e81300) 00010000:00010000:0.0:1788638563.497724:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788638563.497745:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b41b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.497758:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b41b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.497767:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b41b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.497846:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b422 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x5e5b90be bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.497855:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b422 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5e5b90be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.497861:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b422 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5e5b90be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.498067:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b41b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.498075:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b41b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.498082:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b41b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.498087:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638563.498091:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b41b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.498099:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b41b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.498108:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:0.0:1788638563.498111:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638563.498114:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b41b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.498119:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d200/0xa0b1f1e3b4b2b41b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.498128:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b422 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5e5b90be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.498133:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b422 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5e5b90be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.498139:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b422 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5e5b90be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.498290:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638563.498294:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b422 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5e5b90be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.498300:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b422 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5e5b90be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.498309:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x5e5b90be (ffff9c73a1cf7f00) 00010000:00010000:0.0:1788638563.498312:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638563.498315:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b422 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5e5b90be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.498320:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c200/0xa0b1f1e3b4b2b422 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5e5b90be bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638563.498516:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+37:11525:x1875523174215936:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 Request processed in 898us (1057us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788638563.498524:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 176 00000100:00100000:1.0:1788638563.517371:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638563.517440:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174216064 00000100:00100000:3.0:1788638563.517450:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174216064 00000100:00100000:3.0:1788638563.517506:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 177 00000100:00100000:3.0:1788638563.517516:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+37:11525:x1875523174216064:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788638563.517536:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638563.517558:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b429 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435099 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.517610:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b430 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.517623:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.517636:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b430 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.517725:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b429 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435099 expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.517742:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b430 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435099 expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.517751:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c7393e81a00) 00010000:00010000:3.0:1788638563.517754:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788638563.517758:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030000, rc 0) 00000100:00100000:3.0:1788638563.517978:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f27800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+38:11525:x1875523174216064:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 463us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638563.517986:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 177 00000100:00100000:0.0:1788638563.530330:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638563.530401:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174216320 00000100:00100000:2.0:1788638563.530411:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174216320 00000100:00100000:2.0:1788638563.530466:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 178 00000100:00100000:2.0:1788638563.530475:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73c09a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+38:11525:x1875523174216320:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788638563.530555:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b437 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638563.530572:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b437 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638563.530596:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b437 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788638563.530956:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1788638563.530966:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 326602182960ns, next at 327602180612ns, rc = 0 00000004:00010000:2.0:1788638563.531052:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c42f6123 reply state 000000002d2393e3 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b437 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638563.531061:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788638563.531149:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73c09a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+40:11525:x1875523174216320:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 Request processed in 674us (826us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1788638563.531157:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 178 00010000:00010000:3.0:1788638563.533772:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b437 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.533816:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b437 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.533824:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b437 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.533844:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638563.533848:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b437 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.533857:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b437 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.533874:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c7393e81a00) 00010000:00010000:3.0:1788638563.533877:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788638563.533882:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b437 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.533888:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b437 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638563.540448:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638563.540656:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174216448 00000100:00100000:3.0:1788638563.540667:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174216448 00000100:00100000:3.0:1788638563.540728:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 179 00000100:00100000:3.0:1788638563.540738:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+39:11525:x1875523174216448:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788638563.540761:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638563.540814:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b43e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14350a0 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.540875:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b43e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350a0 expref: 40 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.540891:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b43e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350a0 expref: 40 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.540928:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c7393e81a00) 00010000:00010000:3.0:1788638563.540931:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788638563.540935:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031e00, rc 0) 00000100:00100000:3.0:1788638563.540992:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f25f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+40:11525:x1875523174216448:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 255us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638563.540998:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 179 00000100:00100000:1.0:1788638563.543726:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638563.544244:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174216576 00000100:00100000:0.0:1788638563.544254:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174216576 00000100:00100000:0.0:1788638563.544471:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 52 00000100:00100000:0.0:1788638563.544482:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2365:x1875523174216576:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788638563.544846:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2365:x1875523174216576:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 Request processed in 364us (1127us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1788638563.544854:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 52 00000100:00080000:1.0:1788638563.544913:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788638563.552456:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788638563.552485:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183652352:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788638563.552563:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638563.552627:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183652352 00000100:00100000:0.0:1788638563.552635:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183652352 00000100:00100000:0.0:1788638563.552688:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788638563.552698:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1875523183652352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788638563.552730:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638563.552773:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1875523183652352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638563.552803:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788638563.552850:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387dbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183652352:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788638563.552919:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788638563.553949:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638563.555463:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174216832 00000100:00100000:1.0:1788638563.555475:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174216832 00000100:00100000:1.0:1788638563.555535:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 49 00000100:00100000:1.0:1788638563.555545:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+40:11525:x1875523174216832:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788638563.555776:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+41:11525:x1875523174216832:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 Request processed in 232us (1831us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788638563.555802:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 49 00000100:00100000:1.0:1788638563.565341:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638563.566464:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174217088 00000100:00100000:2.0:1788638563.566476:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174217088 00000100:00100000:2.0:1788638563.566538:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 180 00000100:00100000:2.0:1788638563.566549:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+41:11525:x1875523174217088:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788638563.566669:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4891880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+41:11525:x1875523174217088:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 Request processed in 121us (1336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638563.566677:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 180 00000100:00100000:0.0:1788638563.574501:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638563.575004:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174217216 00000100:00100000:3.0:1788638563.575014:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174217216 00000100:00100000:3.0:1788638563.575065:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 181 00000100:00100000:3.0:1788638563.575076:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+41:11525:x1875523174217216:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788638563.575095:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638563.575118:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b445 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14350a7 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.575205:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b44c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.575220:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b44c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.575233:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b44c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638563.575268:0:7634:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788638563.575289:0:7634:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b44c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.575316:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b445 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350a7 expref: 43 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.575345:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b44c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350a7 expref: 42 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.575354:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c7393e81a00) 00010000:00010000:3.0:1788638563.575357:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788638563.575361:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031a00, rc 0) 00000100:00100000:3.0:1788638563.575417:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+42:11525:x1875523174217216:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 343us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638563.575423:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 181 00000100:00100000:3.0:1788638563.584507:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638563.591326:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638563.591376:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638563.591409:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174217472 00000100:00100000:2.0:1788638563.591417:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174217472 00000100:00100000:2.0:1788638563.591463:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 298 00000100:00100000:2.0:1788638563.591472:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:2365:x1875523174217472:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638563.591539:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383683450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:2365:x1875523174217472:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 68us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638563.591560:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 298 00000100:00100000:2.0:1788638563.591596:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174217344 00000100:00100000:2.0:1788638563.591600:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174217344 00000100:00100000:2.0:1788638563.591622:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174217600 00000100:00100000:2.0:1788638563.591624:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174217600 00000100:00100000:2.0:1788638563.591659:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 91 00000100:00100000:2.0:1788638563.591665:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2365:x1875523174217600:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638563.591691:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4899880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2365:x1875523174217600:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 26us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638563.591697:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 91 00000100:00100000:2.0:1788638563.591708:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 53 00000100:00100000:2.0:1788638563.591714:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2364:x1875523174217344:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788638563.591723:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638563.591742:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000808447a6/0xa0b1f1e3b4b2b453 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14350ae expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788638563.591768:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c7563, blocks: 0x1 00010000:00010000:2.0:1788638563.591804:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=326s v=(0 0) 00010000:00010000:2.0:1788638563.591809:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788638563.591818:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000808447a6/0xa0b1f1e3b4b2b453 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ae expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638563.591835:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000808447a6/0xa0b1f1e3b4b2b453 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ae expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638563.591861:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6c00, rc 0) 00000100:00100000:2.0:1788638563.591880:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2364:x1875523174217344:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 167us (7383us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638563.591886:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 53 00000100:00080000:1.0:1788638563.602896:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788638563.617134:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638563.617286:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638563.621362:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174217728 00000100:00100000:1.0:1788638563.621379:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174217728 00000100:00100000:0.0:1788638563.621443:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174217984 00000100:00100000:0.0:1788638563.621448:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174217984 00000100:00100000:0.0:1788638563.621535:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 182 00000100:00100000:0.0:1788638563.621545:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+42:11525:x1875523174217984:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788638563.621646:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4898e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+42:11525:x1875523174217984:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 Request processed in 103us (4359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638563.621653:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 182 00000100:00100000:1.0:1788638563.623940:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 157 00000100:00100000:1.0:1788638563.623952:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2364:x1875523174217728:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638563.624015:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4899c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2364:x1875523174217728:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 65us (6889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638563.624021:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 157 00000100:00080000:2.0:1788638563.624161:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638563.625467:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638563.625536:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174218112 00000100:00100000:3.0:1788638563.625545:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174218112 00000100:00100000:3.0:1788638563.625589:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 54 00000100:00100000:3.0:1788638563.625598:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+8:11525:x1875523174218112:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788638563.625613:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638563.625630:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d5a4507/0xa0b1f1e3b4b2b45a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14350b5 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.625659:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000808447a6/0xa0b1f1e3b4b2b453 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ae expref: 9 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.625668:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788638563.625671:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788638563.625676:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d5a4507/0xa0b1f1e3b4b2b45a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350b5 expref: 9 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.625729:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000808447a6/0xa0b1f1e3b4b2b453 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ae expref: 9 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.625744:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000808447a6/0xa0b1f1e3b4b2b453 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ae expref: 9 pid: 6686 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638563.625758:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6686:1875523183652480:192.168.203.34@tcp:104: 00000100:00100000:3.0:1788638563.625877:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384f66240 going to sleep for 11 seconds 00000100:00100000:2.0:1788638563.631521:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638563.631640:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6686:1875523183652480:192.168.203.34@tcp:104: 00010000:00010000:3.0:1788638563.631674:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009d5a4507/0xa0b1f1e3b4b2b45a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350b5 expref: 9 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.631693:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73813fc400, rc 0) 00000100:00100000:3.0:1788638563.631751:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4899f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+9:11525:x1875523174218112:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 6153us (6290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638563.631861:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 54 00000100:00100000:1.0:1788638563.633084:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174218240 00000100:00100000:1.0:1788638563.633095:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174218240 00010000:00010000:1.0:1788638563.633132:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000808447a6/0xa0b1f1e3b4b2b453 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ae expref: 9 pid: 6686 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638563.633297:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 69 00000100:00100000:1.0:1788638563.633308:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc076300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+9:2365:x1875523174218240:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638563.633323:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638563.633346:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000808447a6/0xa0b1f1e3b4b2b453 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ae expref: 9 pid: 6686 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.633360:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000808447a6/0xa0b1f1e3b4b2b453 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ae expref: 9 pid: 6686 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.633380:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000808447a6/0xa0b1f1e3b4b2b453 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ae expref: 9 pid: 6686 timeout: 426 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.633394:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638563.633397:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638563.633405:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009d5a4507/0xa0b1f1e3b4b2b45a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350b5 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.633415:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d5a4507/0xa0b1f1e3b4b2b45a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350b5 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.633579:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009d5a4507/0xa0b1f1e3b4b2b45a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350b5 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638563.633592:0:5829:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4892680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5829:1875523183652608:192.168.203.34@tcp:105: 00000100:00100000:1.0:1788638563.633666:0:5829:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788638563.638692:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638563.638806:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174218368 00000100:00100000:0.0:1788638563.638815:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174218368 00002000:00100000:0.0:1788638563.638867:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9c73bc075f80 x1875523174218368/t0(0) o4->00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp:539/0 lens 504/0 e 0 to 0 dl 1788638574 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788638563.638879:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c73bc075f80 with x1875523174218368 ext(0->8) 00002000:00010000:0.0:1788638563.638884:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c73bc075f80 00000100:00100000:0.0:1788638563.638931:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 5 00000100:00100000:0.0:1788638563.638942:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+9:2364:x1875523174218368:12345-192.168.203.34@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788638563.639483:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+11:2364:x1875523174218368:12345-192.168.203.34@tcp:4:lhsmtool_posix.0 Request processed in 541us (798us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1788638563.639492:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 5 00002000:00100000:0.0:1788638563.639500:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9c73bc075f80 x1875523174218368/t4294967314(0) o4->00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp:539/0 lens 504/448 e 0 to 0 dl 1788638574 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788638563.639509:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c73bc075f80 with x1875523174218368 ext(0->8) 00002000:00010000:0.0:1788638563.639513:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c73bc075f80 00000100:00100000:1.0:1788638563.641214:0:5829:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4892680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5829:1875523183652608:192.168.203.34@tcp:105: 00010000:00010000:1.0:1788638563.641239:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638563.641346:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc076300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+10:2365:x1875523174218240:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 8039us (9832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638563.641357:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 69 00000100:00100000:2.0:1788638563.643945:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638563.644017:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174218496 00000100:00100000:3.0:1788638563.644025:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174218496 00000100:00100000:3.0:1788638563.644074:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 183 00000100:00100000:3.0:1788638563.644082:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+42:11525:x1875523174218496:12345-192.168.203.34@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1788638563.680076:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+42:11525:x1875523174218496:12345-192.168.203.34@tcp:44:lhsmtool_posix.0 Request processed in 35983us (36128us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638563.680089:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 183 00000001:00080000:1.0:1788638563.681299:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000001:00080000:1.0:1788638563.681336:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000020:00080000:1.0:1788638563.681351:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:1.0:1788638563.681364:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:0.0:1788638563.681459:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:0.0:1788638563.681474:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788638563.681687:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183652736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788638563.681749:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638563.681966:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183652736 00000100:00100000:2.0:1788638563.681974:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183652736 00000100:00100000:2.0:1788638563.682041:0:11999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788638563.682051:0:11999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183652736:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788638563.682235:0:11999:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788638563.682238:0:11999:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788638563 00002000:00010000:2.0:1788638563.682241:0:11999:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788638563.682243:0:11999:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788638563 -> 1788638563 00002000:00010000:2.0:1788638563.682245:0:11999:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788638563.682290:0:11999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3294:x1875523183652736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 241us (541us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788638563.682297:0:11999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:2.0:1788638563.682336:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c7385379c00/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788638563.682342:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183652736:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1788638563.682543:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788638563.683891:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638563.684143:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174218624 00000100:00100000:3.0:1788638563.684211:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174218624 00000100:00100000:3.0:1788638563.684296:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 56 00000100:00100000:3.0:1788638563.684305:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+10:2366:x1875523174218624:12345-192.168.203.34@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788638563.713422:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:0.0:1788638563.713532:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1788638563.713688:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2366:x1875523174218624:12345-192.168.203.34@tcp:16:lhsmtool_posix.0 Request processed in 29378us (29797us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638563.713700:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 56 00000100:00100000:2.0:1788638563.718949:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638563.719045:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174218880 00000100:00100000:0.0:1788638563.719055:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174218880 00000100:00100000:0.0:1788638563.719112:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 184 00000100:00100000:0.0:1788638563.719121:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+18:11525:x1875523174218880:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788638563.719288:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638563.719311:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b44c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350a7 expref: 18 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.719343:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c7393e81a00) 00010000:00010000:0.0:1788638563.719349:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788638563.719379:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b461 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.719397:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b461 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.719408:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b461 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788638563.720324:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002520e956 reply state 0000000010912f8f transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b461 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638563.720336:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788638563.720560:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+19:11525:x1875523174218880:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 Request processed in 1438us (1619us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788638563.720568:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 184 00010000:00010000:1.0:1788638563.723389:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b461 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.723407:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b461 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.723415:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b461 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.723422:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638563.723426:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b461 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.723435:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b461 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.723452:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c7393e81a00) 00010000:00010000:1.0:1788638563.723468:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638563.723474:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b461 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.723481:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b461 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638563.723603:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638563.723676:0:11999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174219008 00000100:00100000:1.0:1788638563.723686:0:11999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174219008 00000100:00100000:1.0:1788638563.723748:0:11999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 57 00000100:00100000:1.0:1788638563.723758:0:11999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2364:x1875523174219008:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788638563.724048:0:11999:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788638563.724051:0:11999:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788638563 -> 1788638562 00002000:00010000:1.0:1788638563.724054:0:11999:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788638560 00002000:00010000:1.0:1788638563.724056:0:11999:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788638563 -> 1788638562 00002000:00010000:1.0:1788638563.724058:0:11999:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788638563.724122:0:11999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2364:x1875523174219008:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 Request processed in 365us (522us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788638563.724129:0:11999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 57 00000100:00100000:2.0:1788638563.726949:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638563.727035:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174219264 00000100:00100000:1.0:1788638563.727044:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174219264 00000100:00100000:1.0:1788638563.727136:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 185 00000100:00100000:1.0:1788638563.727156:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+18:11525:x1875523174219264:12345-192.168.203.34@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788638563.727235:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b468 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.727252:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b430 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435099 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.727278:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b468 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.727310:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b430 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435099 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.727324:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b430 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435099 expref: 18 pid: 5843 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638563.727337:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4892680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875523183652864:192.168.203.34@tcp:104: 00000100:00100000:1.0:1788638563.727462:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788638563.730038:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4892680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875523183652864:192.168.203.34@tcp:104: 00010000:00010000:1.0:1788638563.730065:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b468 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638563.732573:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638563.732751:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174219392 00000100:00100000:1.0:1788638563.732761:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174219392 00010000:00010000:1.0:1788638563.732872:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b430 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435099 expref: 19 pid: 5843 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638563.732953:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 70 00000100:00100000:1.0:1788638563.732963:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+19:2365:x1875523174219392:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638563.732976:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638563.732982:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b430 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435099 expref: 19 pid: 5843 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.733013:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b430 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435099 expref: 19 pid: 5843 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.733034:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b430 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435099 expref: 19 pid: 5843 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.733050:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c7393e81a00) 00010000:00010000:1.0:1788638563.733056:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b468 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.733066:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b468 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.733073:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b468 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.733102:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638563.733165:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb79880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+18:2365:x1875523174219392:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 204us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638563.733173:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 70 00010000:00010000:2.0:1788638563.733448:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b468 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638563.733456:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b468 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638563.733481:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b468 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638563.733488:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b468 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638563.733494:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b468 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638563.733499:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638563.733503:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b468 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638563.733510:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b468 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638563.733519:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c7393e81a00) 00010000:00010000:2.0:1788638563.733521:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788638563.733525:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b468 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638563.733541:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b468 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638563.733587:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+17:11525:x1875523174219264:12345-192.168.203.34@tcp:55:lhsmtool_posix.0 Request processed in 6443us (6649us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788638563.733595:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 185 00000100:00100000:2.0:1788638563.736027:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638563.736166:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174219520 00000100:00100000:3.0:1788638563.736176:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174219520 00000100:00100000:3.0:1788638563.736244:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 58 00000100:00100000:3.0:1788638563.736254:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2364:x1875523174219520:12345-192.168.203.34@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788638563.736294:0:6686:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b2a00941/0xa0b1f1e3b4b2b46f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.736315:0:6686:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009d5a4507/0xa0b1f1e3b4b2b45a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350b5 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.736323:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788638563.736327:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788638563.736332:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2a00941/0xa0b1f1e3b4b2b46f lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.736368:0:6686:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009d5a4507/0xa0b1f1e3b4b2b45a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350b5 expref: 8 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.736381:0:6686:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009d5a4507/0xa0b1f1e3b4b2b45a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350b5 expref: 8 pid: 6686 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638563.736414:0:6686:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6686:1875523183652992:192.168.203.34@tcp:104: 00000100:00100000:3.0:1788638563.736487:0:6686:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c32b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788638563.740372:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638563.740489:0:6686:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6686:1875523183652992:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638563.740515:0:6686:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b2a00941/0xa0b1f1e3b4b2b46f lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638563.740654:0:11689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174219648 00000100:00100000:0.0:1788638563.740662:0:11689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174219648 00010000:00010000:0.0:1788638563.740709:0:11689:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d5a4507/0xa0b1f1e3b4b2b45a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350b5 expref: 9 pid: 6686 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638563.740749:0:11689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 71 00000100:00100000:0.0:1788638563.740759:0:11689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+9:2364:x1875523174219648:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788638563.740820:0:11689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638563.740843:0:11689:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009d5a4507/0xa0b1f1e3b4b2b45a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350b5 expref: 9 pid: 6686 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.740857:0:11689:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009d5a4507/0xa0b1f1e3b4b2b45a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350b5 expref: 9 pid: 6686 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.740881:0:11689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d5a4507/0xa0b1f1e3b4b2b45a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350b5 expref: 9 pid: 6686 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.740918:0:11689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788638563.740923:0:11689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788638563.740928:0:11689:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2a00941/0xa0b1f1e3b4b2b46f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.740939:0:11689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2a00941/0xa0b1f1e3b4b2b46f lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638563.740963:0:11689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638563.741019:0:11689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2364:x1875523174219648:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 261us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638563.741027:0:11689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 71 00010000:00010000:3.0:1788638563.741209:0:6686:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b2a00941/0xa0b1f1e3b4b2b46f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.741219:0:6686:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2a00941/0xa0b1f1e3b4b2b46f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.741244:0:6686:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b2a00941/0xa0b1f1e3b4b2b46f lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.741253:0:6686:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2a00941/0xa0b1f1e3b4b2b46f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.741261:0:6686:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2a00941/0xa0b1f1e3b4b2b46f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.741268:0:6686:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fce00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638563.741273:0:6686:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2a00941/0xa0b1f1e3b4b2b46f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.741281:0:6686:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2a00941/0xa0b1f1e3b4b2b46f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.741308:0:6686:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2a00941/0xa0b1f1e3b4b2b46f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.741316:0:6686:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2a00941/0xa0b1f1e3b4b2b46f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638563.741375:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2364:x1875523174219520:12345-192.168.203.34@tcp:1:lhsmtool_posix.0 Request processed in 5121us (5356us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638563.741383:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 58 00000100:00100000:3.0:1788638563.751069:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638563.751173:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174219904 00000100:00100000:1.0:1788638563.751182:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174219904 00000100:00100000:1.0:1788638563.751249:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 186 00000100:00100000:1.0:1788638563.751259:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+17:11525:x1875523174219904:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788638563.751338:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b476 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.751356:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b476 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.751383:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b476 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.751597:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b47d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.751609:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b43e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350a0 expref: 18 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.751617:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b47d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.751649:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b43e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350a0 expref: 18 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.751663:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b43e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350a0 expref: 18 pid: 7634 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638563.751677:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4892680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875523183653120:192.168.203.34@tcp:104: 00000100:00100000:1.0:1788638563.751757:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1788638563.755369:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638563.755556:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174220032 00000100:00100000:2.0:1788638563.755566:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174220032 00010000:00010000:2.0:1788638563.755614:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b43e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350a0 expref: 19 pid: 7634 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638563.755656:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 72 00000100:00100000:2.0:1788638563.755665:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+19:2364:x1875523174220032:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638563.755679:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638563.755685:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b43e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350a0 expref: 19 pid: 7634 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638563.755707:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b43e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350a0 expref: 19 pid: 7634 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638563.755728:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c7393e81a00) 00010000:00010000:2.0:1788638563.755745:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b47d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638563.755755:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b47d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638563.756095:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b47d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638563.756117:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638563.756181:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+19:2364:x1875523174220032:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 516us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638563.756199:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 72 00010000:00010000:1.0:1788638563.757744:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b43e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350a0 expref: 18 pid: 7634 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638563.757916:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4892680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875523183653120:192.168.203.34@tcp:104: 00010000:00010000:1.0:1788638563.757938:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b47d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.757948:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b47d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.757970:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b47d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788638563.758144:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:1.0:1788638563.758304:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:1.0:1788638563.758343:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:1.0:1788638563.758538:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4892680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1875523183653248:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788638563.758614:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638563.758653:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304a000 going to sleep for 11 seconds 00000100:00100000:2.0:1788638563.758985:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183653248 00000100:00100000:2.0:1788638563.758993:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183653248 00000100:00100000:2.0:1788638563.759090:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788638563.759099:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875523183653248:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788638563.759203:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad495c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875523183653248:12345-0@lo:1000:mdt00_001.0 Request processed in 106us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638563.759210:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788638563.759270:0:5843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1788638563.759276:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c7385379c00, transno 4294967315 00000100:00100000:1.0:1788638563.759298:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4892680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1875523183653248:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788638563.759982:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:1.0:1788638563.760049:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad495f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1875523183653376:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788638563.760098:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638563.760993:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788638563.761025:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183653376 00000100:00100000:3.0:1788638563.761032:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183653376 00000100:00100000:3.0:1788638563.761068:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788638563.761077:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1875523183653376:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788638563.761400:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad494e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1875523183653376:12345-0@lo:1000:mdt00_001.0 Request processed in 323us (1301us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788638563.761408:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788638563.761598:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad495f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1875523183653376:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788638563.761634:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b47d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.761644:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b47d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.761651:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b47d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.761657:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638563.761661:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b47d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.761680:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b47d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.761894:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c7393e81a00) 00010000:00010000:1.0:1788638563.761898:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788638563.761904:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b47d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.761910:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b47d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.761942:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b3b9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.761948:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b3b9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.761953:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b3b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.761957:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01dc00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638563.761960:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b3b9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.761966:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b3b9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.761974:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c73a1cf7900) 00010000:00010000:1.0:1788638563.761976:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788638563.761979:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b3b9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.761995:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b3b9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.762016:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b484 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.762029:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b3d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435084 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.762037:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b484 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.762066:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b3d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435084 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638563.762080:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b3d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435084 expref: 21 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638563.762091:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad495880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875523183653504:192.168.203.34@tcp:104: 00000100:00100000:1.0:1788638563.762274:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788638563.766250:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638563.766735:0:11689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174220160 00000100:00100000:2.0:1788638563.766744:0:11689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174220160 00010000:00010000:2.0:1788638563.766818:0:11689:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b3d5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435084 expref: 22 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638563.766859:0:11689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 73 00000100:00100000:2.0:1788638563.766868:0:11689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad496d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+22:2365:x1875523174220160:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638563.766881:0:11689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638563.766888:0:11689:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b3d5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435084 expref: 22 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638563.766914:0:11689:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b3d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435084 expref: 22 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638563.766935:0:11689:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c73a1cf7900) 00010000:00010000:2.0:1788638563.766940:0:11689:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b484 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638563.766950:0:11689:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b484 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638563.766957:0:11689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b484 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638563.766976:0:11689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638563.767028:0:11689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad496d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+22:2365:x1875523174220160:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 161us (787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638563.767036:0:11689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 73 00010000:00010000:3.0:1788638563.768234:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b3d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435084 expref: 21 pid: 5844 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638563.768255:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad495880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875523183653504:192.168.203.34@tcp:104: 00010000:00010000:3.0:1788638563.768275:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b484 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.768283:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b484 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.768301:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b484 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.768313:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b484 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.768319:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b484 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.768326:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b484 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.768332:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638563.768336:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b484 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.768343:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b484 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.768355:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c73a1cf7900) 00010000:00010000:3.0:1788638563.768357:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638563.768361:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b484 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.768366:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b484 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.768377:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b476 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.768383:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b476 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.768394:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b476 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.768399:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638563.768402:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b476 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.768408:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b476 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.768416:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c73a1cf7900) 00010000:00010000:3.0:1788638563.768418:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788638563.768562:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b476 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.768570:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b476 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638563.769070:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+20:11525:x1875523174219904:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 Request processed in 17810us (18007us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1788638563.769080:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 186 00000020:00080000:3.0:1788638563.769085:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788638563.771265:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638563.771340:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174220416 00000100:00100000:3.0:1788638563.771351:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174220416 00000100:00100000:3.0:1788638563.771410:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 50 00000100:00100000:3.0:1788638563.771420:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73a5715850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+20:11525:x1875523174220416:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788638563.772085:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788638563.772199:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:3.0:1788638563.772255:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fce00/0xa0b1f1e3b4b2b48b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.772272:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fce00/0xa0b1f1e3b4b2b48b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.772283:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fce00/0xa0b1f1e3b4b2b48b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.772291:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fce00/0xa0b1f1e3b4b2b48b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.772297:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fce00/0xa0b1f1e3b4b2b48b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.772303:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fce00/0xa0b1f1e3b4b2b48b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.772324:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788638563.772410:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73a5715850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+22:11525:x1875523174220416:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 Request processed in 990us (1153us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788638563.772419:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 50 00000020:00080000:3.0:1788638563.772424:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788638563.772480:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638563.772486:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fce00/0xa0b1f1e3b4b2b48b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.772492:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fce00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638563.772496:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fce00/0xa0b1f1e3b4b2b48b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.772504:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fce00/0xa0b1f1e3b4b2b48b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.772523:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9c7393e81300) 00010000:00010000:3.0:1788638563.772526:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788638563.772531:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fce00/0xa0b1f1e3b4b2b48b lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.772538:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fce00/0xa0b1f1e3b4b2b48b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638563.772555:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638563.772557:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638563.772559:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788638563.775378:0:11706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788638563.775388:0:11706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788638563.776359:0:11706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788638563.776397:0:11706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788638564.256308:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788638564.833202:0:11706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788638564.833212:0:11706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788638564.833419:0:11706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788638564.833449:0:11706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788638565.205000:0:12487:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788638565.205009:0:12487:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788638565.205045:0:12487:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788638565.205051:0:12487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788638565.280931:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638565.324474:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638565.324554:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174220672 00000100:00100000:3.0:1788638565.324565:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174220672 00000100:00100000:3.0:1788638565.324644:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 187 00000100:00100000:3.0:1788638565.324656:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+22:11543:x1875523174220672:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:3.0:1788638565.324679:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638565.324713:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b492 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14350bc expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.324845:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fce00/0xa0b1f1e3b4b2b499 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.324861:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fce00/0xa0b1f1e3b4b2b499 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.324872:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fce00/0xa0b1f1e3b4b2b499 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638565.324883:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788638565.324997:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b492 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350bc expref: 25 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.325027:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fce00/0xa0b1f1e3b4b2b499 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350bc expref: 24 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.325036:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:3.0:1788638565.325039:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788638565.325043:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73813fce00, rc 0) 00000100:00100000:3.0:1788638565.325096:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad495500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+24:11543:x1875523174220672:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 444us (632us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788638565.325103:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 187 00000100:00080000:2.0:1788638565.325725:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638565.329113:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638565.329224:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174220800 00000100:00100000:1.0:1788638565.329239:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174220800 00000100:00100000:1.0:1788638565.329298:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 188 00000100:00100000:1.0:1788638565.329309:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+24:11543:x1875523174220800:12345-192.168.203.34@tcp:34:lfs.0 00010000:00010000:1.0:1788638565.329380:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329398:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329411:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329425:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b4ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329432:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b4ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329438:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b4ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329655:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b4b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329664:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329671:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788638565.329710:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329734:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329750:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329758:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329763:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638565.329768:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329776:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329817:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:1.0:1788638565.329821:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638565.329825:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329832:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329842:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b4ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329848:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b4ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329854:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b4ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329864:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638565.329868:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b4ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329874:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b4ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329881:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c7398420d00) 00010000:00010000:1.0:1788638565.329884:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638565.329886:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b4ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329892:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b4ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329905:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b4b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329910:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b4b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329915:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b4b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329920:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638565.329922:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b4b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329928:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b4b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329944:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7398420200) 00010000:00010000:1.0:1788638565.329947:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638565.329950:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b4b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.329956:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308a00/0xa0b1f1e3b4b2b4b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638565.330026:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+24:11543:x1875523174220800:12345-192.168.203.34@tcp:34:lfs.0 Request processed in 718us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638565.330033:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 188 00000100:00100000:0.0:1788638565.378033:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638565.378068:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174221056 00000100:00100000:0.0:1788638565.378077:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174221056 00000100:00100000:0.0:1788638565.378125:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 189 00000100:00100000:0.0:1788638565.378134:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+24:11546:x1875523174221056:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638565.378155:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638565.378186:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b4bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14350c3 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378264:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b4c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378279:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b4c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378301:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b4c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378317:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b4ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378324:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b4ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378330:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b4ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378575:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b4d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378584:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378590:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b4d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638565.378600:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788638565.378692:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b4c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378699:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b4c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378706:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b4c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378711:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01da00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638565.378722:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b4c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378729:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b4c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378741:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:0.0:1788638565.378744:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638565.378748:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b4c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378754:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b4c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378765:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b4ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378770:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b4ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378775:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b4ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378780:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01ce00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638565.378808:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b4ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378814:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b4ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378821:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c73a1cf7b00) 00010000:00010000:0.0:1788638565.378823:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638565.378834:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b4ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378839:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b4ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378880:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01dc00/0xa0b1f1e3b4b2b4bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350c3 expref: 27 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378893:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b4d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350c3 expref: 26 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.378899:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:0.0:1788638565.378902:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788638565.378904:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01d000, rc 0) 00000100:00100000:0.0:1788638565.378964:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+26:11546:x1875523174221056:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 831us (938us total) trans 4294967470 rc 0/0 00000100:00100000:0.0:1788638565.378972:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 189 00000100:00100000:2.0:1788638565.386435:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638565.386473:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174221184 00000100:00100000:2.0:1788638565.386482:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174221184 00000100:00100000:2.0:1788638565.386546:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 190 00000100:00100000:2.0:1788638565.386556:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+26:11546:x1875523174221184:12345-192.168.203.34@tcp:54:lfs.0 00010000:00010000:2.0:1788638565.386619:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b4df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.386636:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b4df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.386648:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b4df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.386673:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b4df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.386679:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b4df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.386686:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b4df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.386691:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638565.386695:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b4df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.386703:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b4df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.386714:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:2.0:1788638565.386717:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788638565.386730:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b4df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.386737:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b4df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638565.386837:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+26:11546:x1875523174221184:12345-192.168.203.34@tcp:54:lfs.0 Request processed in 282us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638565.386845:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 190 00000100:00100000:1.0:1788638565.391931:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638565.392050:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174221440 00000100:00100000:2.0:1788638565.392059:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174221440 00000100:00100000:2.0:1788638565.392133:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 51 00000100:00100000:2.0:1788638565.392150:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+26:11546:x1875523174221440:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:2.0:1788638565.392405:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+27:11546:x1875523174221440:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 257us (483us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1788638565.392413:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 51 00000100:00100000:2.0:1788638565.428545:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638565.428873:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174221696 00000100:00100000:1.0:1788638565.428884:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174221696 00000100:00100000:1.0:1788638565.428944:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 191 00000100:00100000:1.0:1788638565.428955:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+27:11072:x1875523174221696:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:1.0:1788638565.428997:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638565.429019:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b4e6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14350ca expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.429117:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4ed lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.429131:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b4d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350c3 expref: 28 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.429140:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4ed lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.429201:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b4d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350c3 expref: 28 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.429215:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b4d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350c3 expref: 28 pid: 7634 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638565.429229:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad497480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875523183653632:192.168.203.34@tcp:104: 00000100:00100000:1.0:1788638565.429677:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c35f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788638565.431534:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad497480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875523183653632:192.168.203.34@tcp:104: 00010000:00010000:1.0:1788638565.431576:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4ed lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638565.432872:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638565.433277:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174221824 00000100:00100000:3.0:1788638565.433286:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174221824 00010000:00010000:3.0:1788638565.433327:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b4d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350c3 expref: 29 pid: 7634 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638565.433417:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 74 00000100:00100000:3.0:1788638565.433436:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+29:2364:x1875523174221824:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788638565.433451:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638565.433459:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b4d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350c3 expref: 29 pid: 7634 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.433482:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b4d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350c3 expref: 29 pid: 7634 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.433503:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d000/0xa0b1f1e3b4b2b4d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350c3 expref: 29 pid: 7634 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.433536:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:3.0:1788638565.433541:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4ed lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.433550:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.433557:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4ed lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.433589:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638565.433649:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+28:2364:x1875523174221824:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 215us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638565.433664:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 74 00010000:00010000:1.0:1788638565.433719:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.433727:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4ed lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788638565.433745:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788638565.433926:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b4e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ca expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.433942:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ca expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.433949:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:1.0:1788638565.433952:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788638565.433961:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309800, rc 0) 00000100:00100000:1.0:1788638565.434002:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+28:11072:x1875523174221696:12345-192.168.203.34@tcp:101:bash.0 Request processed in 5049us (5467us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1788638565.434009:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 191 00000100:00100000:2.0:1788638565.437190:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638565.437299:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174222080 00000100:00100000:1.0:1788638565.437310:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174222080 00000100:00100000:1.0:1788638565.437401:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 192 00000100:00100000:1.0:1788638565.437422:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+28:11072:x1875523174222080:12345-192.168.203.34@tcp:36:bash.0 00010000:00010000:1.0:1788638565.437712:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b4fb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.437730:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b4fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.437742:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b4fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788638565.437832:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1788638565.437864:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000be26a9c reply state 00000000f4c54ce1 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b4fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638565.437873:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788638565.437919:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1788638565.438026:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+32:11072:x1875523174222080:12345-192.168.203.34@tcp:36:bash.0 Request processed in 615us (1558us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1788638565.438034:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 192 00000020:00080000:1.0:1788638565.438039:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1788638565.440990:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b4fb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.441008:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b4fb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.441016:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b4fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.441022:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638565.441027:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b4fb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.441035:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b4fb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.441073:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:3.0:1788638565.441076:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638565.441081:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b4fb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.441088:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309600/0xa0b1f1e3b4b2b4fb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638565.443638:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638565.444009:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174222208 00000100:00100000:0.0:1788638565.444019:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174222208 00000100:00100000:0.0:1788638565.444075:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 193 00000100:00100000:0.0:1788638565.444085:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+31:11072:x1875523174222208:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:0.0:1788638565.444118:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638565.444136:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b502 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14350d1 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.444226:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b502 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350d1 expref: 32 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.444266:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b502 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350d1 expref: 32 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.444295:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:0.0:1788638565.444298:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788638565.444302:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01c600, rc 0) 00000100:00100000:0.0:1788638565.444378:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+32:11072:x1875523174222208:12345-192.168.203.34@tcp:101:bash.0 Request processed in 293us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638565.444391:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 193 00000100:00100000:0.0:1788638565.447281:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638565.447566:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174222336 00000100:00100000:2.0:1788638565.447576:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174222336 00000100:00100000:2.0:1788638565.447642:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 59 00000100:00100000:2.0:1788638565.447653:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+7:11072:x1875523174222336:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:2.0:1788638565.447668:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638565.447688:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000808447a6/0xa0b1f1e3b4b2b509 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14350d8 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788638565.447744:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c7562, atime: 0x6a9c7560, ctime: 0x6a9c7562, blocks: 0xb 00010000:00010000:2.0:1788638565.447767:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=328s v=(0 0) 00010000:00010000:2.0:1788638565.447771:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788638565.447932:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000808447a6/0xa0b1f1e3b4b2b509 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350d8 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.447955:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000808447a6/0xa0b1f1e3b4b2b509 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350d8 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.448037:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6c00, rc 0) 00000100:00080000:0.0:1788638565.448192:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788638565.448260:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+8:11072:x1875523174222336:12345-192.168.203.34@tcp:101:bash.0 Request processed in 606us (984us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638565.448268:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 59 00000100:00100000:3.0:1788638565.451539:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638565.451768:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174222464 00000100:00100000:2.0:1788638565.451778:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174222464 00002000:00010000:2.0:1788638565.451844:0:6692:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1788638565.451847:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c73acdcb480 with x1875523174222464 ext(0->18446744073709551615) 00002000:00010000:2.0:1788638565.451859:0:6692:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c73acdcb480. 00000100:00100000:2.0:1788638565.451891:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00100000:2.0:1788638565.451902:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2365:x1875523174222464:12345-192.168.203.34@tcp:10:bash.0 00002000:00010000:2.0:1788638565.452276:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788638565.452280:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788638562 -> 1788638565 00002000:00010000:2.0:1788638565.452283:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788638560 -> 1788638560 00002000:00010000:2.0:1788638565.452286:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788638562 -> 1788638565 00002000:00010000:2.0:1788638565.452288:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788638565.452536:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+9:2365:x1875523174222464:12345-192.168.203.34@tcp:10:bash.0 Request processed in 634us (1004us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1788638565.452560:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 6 00002000:00010000:2.0:1788638565.452564:0:6692:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1788638565.452567:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c73acdcb480 with x1875523174222464 ext(0->18446744073709551615) 00002000:00010000:2.0:1788638565.452573:0:6692:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c73acdcb480. 00000100:00100000:2.0:1788638565.522067:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638565.522183:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174222592 00000100:00100000:3.0:1788638565.522193:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174222592 00000100:00100000:3.0:1788638565.522256:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 194 00000100:00100000:3.0:1788638565.522266:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+32:11560:x1875523174222592:12345-192.168.203.34@tcp:34:lfs.0 00010000:00010000:3.0:1788638565.522351:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b510 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.522368:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b510 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.522380:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b510 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.522402:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b517 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.522410:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.522418:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.522667:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b51e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.522677:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b51e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.523655:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b51e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788638565.523929:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b51e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.523943:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b510 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.523949:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b510 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.523956:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b510 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.523962:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fda00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638565.523965:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b510 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.523972:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b510 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.523983:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:2.0:1788638565.524278:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638565.524286:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b510 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.524357:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b510 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.524456:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b517 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.524463:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b517 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.524537:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b517 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.524542:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fd000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638565.524544:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b517 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.524551:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b517 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.524560:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c7393e81300) 00010000:00010000:2.0:1788638565.524562:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638565.524566:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b517 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.524572:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b517 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.524589:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b51e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.524594:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b51e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.524600:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b51e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.524611:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fd800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638565.524614:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b51e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.524620:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b51e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.524627:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:2.0:1788638565.524630:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638565.524632:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b51e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.524637:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b51e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638565.524965:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+32:11560:x1875523174222592:12345-192.168.203.34@tcp:34:lfs.0 Request processed in 2695us (2901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638565.524975:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 194 00000100:00100000:0.0:1788638565.562123:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638565.564924:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174222848 00000100:00100000:3.0:1788638565.564939:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174222848 00000100:00100000:3.0:1788638565.565075:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 195 00000100:00100000:3.0:1788638565.565086:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+32:11563:x1875523174222848:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:3.0:1788638565.565109:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638565.565132:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b525 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14350df expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565219:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b52c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565234:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b52c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565246:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b52c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565259:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b533 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565266:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565286:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565541:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b53a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565551:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b53a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565559:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b53a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638565.565568:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788638565.565654:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b52c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565662:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b52c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565669:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b52c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565674:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fd800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638565.565679:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b52c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565687:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b52c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565700:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:3.0:1788638565.565703:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638565.565727:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b52c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565741:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b52c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565757:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565764:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b533 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565770:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b533 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565776:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fd000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638565.565779:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b533 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565832:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b533 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565841:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c7393e81700) 00010000:00010000:3.0:1788638565.565844:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638565.565847:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b533 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565853:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b533 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565897:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b525 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350df expref: 35 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565925:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b53a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350df expref: 34 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.565934:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:3.0:1788638565.565936:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788638565.565939:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73813fda00, rc 0) 00000100:00100000:3.0:1788638565.566012:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+34:11563:x1875523174222848:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 928us (3898us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1788638565.566021:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 195 00000100:00100000:3.0:1788638565.571809:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638565.572079:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174222976 00000100:00100000:1.0:1788638565.572089:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174222976 00000100:00100000:1.0:1788638565.572154:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 196 00000100:00100000:1.0:1788638565.572164:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+34:11563:x1875523174222976:12345-192.168.203.34@tcp:54:lfs.0 00010000:00010000:1.0:1788638565.572249:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b548 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.572265:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4ed lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ca expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.572276:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b548 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.572310:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ca expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.572326:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4ed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ca expref: 34 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638565.572340:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad497480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875523183653760:192.168.203.34@tcp:104: 00000100:00100000:1.0:1788638565.572427:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7c35a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788638565.576847:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638565.576978:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174223232 00000100:00100000:3.0:1788638565.576986:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174223232 00000100:00100000:3.0:1788638565.577046:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 52 00000100:00100000:3.0:1788638565.577056:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+35:5606:x1875523174223232:12345-192.168.203.34@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788638565.577393:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+36:5606:x1875523174223232:12345-192.168.203.34@tcp:35:ldlm_bl.0 Request processed in 337us (553us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788638565.577401:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 52 00000100:00100000:1.0:1788638565.577948:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad497480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875523183653760:192.168.203.34@tcp:104: 00010000:00010000:1.0:1788638565.577983:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b548 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638565.581213:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638565.581345:0:11689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174223360 00000100:00100000:2.0:1788638565.581354:0:11689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174223360 00010000:00010000:2.0:1788638565.581397:0:11689:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4ed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ca expref: 36 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638565.581452:0:11689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 75 00000100:00100000:2.0:1788638565.581462:0:11689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dfb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+36:2364:x1875523174223360:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638565.581486:0:11689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638565.581494:0:11689:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4ed lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ca expref: 36 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.581526:0:11689:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4ed lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ca expref: 36 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.581547:0:11689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b4ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ca expref: 36 pid: 5842 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.581565:0:11689:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:2.0:1788638565.581570:0:11689:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b548 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.581580:0:11689:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b548 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.581588:0:11689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b548 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.581627:0:11689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638565.581687:0:11689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dfb050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+35:2364:x1875523174223360:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 227us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638565.581695:0:11689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 75 00010000:00010000:3.0:1788638565.581913:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b548 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.581922:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b548 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.581954:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b548 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.581961:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b548 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.581976:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b548 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.581981:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638565.581986:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b548 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.581993:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b548 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.582003:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:3.0:1788638565.582006:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788638565.582009:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b548 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.582016:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b548 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638565.582058:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+34:11563:x1875523174222976:12345-192.168.203.34@tcp:54:lfs.0 Request processed in 9896us (10282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638565.582066:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 196 00000100:00100000:0.0:1788638565.588495:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638565.589565:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174223616 00000100:00100000:3.0:1788638565.589576:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174223616 00000100:00100000:3.0:1788638565.589685:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 53 00000100:00100000:3.0:1788638565.589696:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+34:11563:x1875523174223616:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:3.0:1788638565.589960:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+35:11563:x1875523174223616:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 266us (1473us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788638565.589968:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 53 00000100:00100000:1.0:1788638565.603966:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183654016:0@lo:400:kworker.0 00000100:00100000:1.0:1788638565.604032:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638565.604064:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183654528:0@lo:400:kworker.0 00000100:00100000:1.0:1788638565.604100:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638565.604122:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788638565.604128:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3292:1875523183653888:0@lo:400:kworker.0 00000100:00100000:1.0:1788638565.604154:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638565.604190:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1875523183654400:0@lo:400:kworker.0 00000100:00100000:1.0:1788638565.604213:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638565.604240:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183654144:0@lo:400:kworker.0 00000100:00100000:1.0:1788638565.604264:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638565.604280:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788638565.604286:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183654272:0@lo:400:kworker.0 00000100:00100000:1.0:1788638565.604307:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638565.604339:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183653888 00000100:00100000:1.0:1788638565.604346:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183653888 00000100:00100000:1.0:1788638565.604386:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788638565.604394:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3292:x1875523183653888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638565.604438:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383682450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3292:x1875523183653888:12345-0@lo:400:kworker.0 Request processed in 44us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638565.604445:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1788638565.604473:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183654528 00000100:00100000:1.0:1788638565.604476:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183654528 00000100:00100000:1.0:1788638565.604506:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183654272 00000100:00100000:1.0:1788638565.604509:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183654272 00000100:00100000:1.0:1788638565.604527:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788638565.604533:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3292:x1875523183654528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638565.604561:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad494380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3292:x1875523183654528:12345-0@lo:400:kworker.0 Request processed in 28us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638565.604577:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788638565.604591:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788638565.604597:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3293:x1875523183654272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638565.604631:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad494700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3293:x1875523183654272:12345-0@lo:400:kworker.0 Request processed in 34us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638565.604637:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:1.0:1788638565.604655:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788638565.604659:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788638565.604686:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad495180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183654272:0@lo:400:kworker.0 00000100:00100000:1.0:1788638565.604710:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad497480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3292:1875523183653888:0@lo:400:kworker.0 00000100:00100000:1.0:1788638565.604720:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad494a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183654528:0@lo:400:kworker.0 00000100:00100000:1.0:1788638565.604742:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183654016 00000100:00100000:1.0:1788638565.604745:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183654016 00000100:00100000:1.0:1788638565.604864:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183654400 00000100:00100000:1.0:1788638565.604868:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183654400 00000100:00100000:1.0:1788638565.604886:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183654144 00000100:00100000:1.0:1788638565.604889:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183654144 00000100:00100000:1.0:1788638565.604903:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788638565.604909:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183654016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638565.604946:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad496300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183654016:12345-0@lo:400:kworker.0 Request processed in 37us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638565.604952:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788638565.604963:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788638565.604969:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875523183654400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638565.604995:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad497800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875523183654400:12345-0@lo:400:kworker.0 Request processed in 26us (781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638565.605007:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788638565.605019:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788638565.605025:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183654144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638565.605060:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad496a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183654144:12345-0@lo:400:kworker.0 Request processed in 35us (795us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638565.605066:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:1.0:1788638565.605080:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788638565.605098:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad494000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183654144:0@lo:400:kworker.0 00000100:00100000:1.0:1788638565.605120:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad496680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1875523183654400:0@lo:400:kworker.0 00000100:00100000:1.0:1788638565.605129:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad497b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183654016:0@lo:400:kworker.0 00000100:00100000:0.0:1788638565.637619:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638565.637680:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638565.637780:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174223872 00000100:00100000:1.0:1788638565.637821:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174223872 00000100:00100000:1.0:1788638565.637882:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 60 00000100:00100000:1.0:1788638565.637891:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+9:2365:x1875523174223872:12345-192.168.203.34@tcp:16:kworker.0 00000100:00100000:2.0:1788638565.640547:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174223744 00000100:00100000:2.0:1788638565.640563:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174223744 00002000:00100000:2.0:1788638565.640614:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->7) req@ffff9c72826a1880 x1875523174223744/t0(0) o4->00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp:541/0 lens 496/0 e 0 to 0 dl 1788638576 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788638565.640626:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c72826a1880 with x1875523174223744 ext(0->7) 00002000:00010000:2.0:1788638565.640631:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c72826a1880 00000100:00100000:2.0:1788638565.640668:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 7 00000100:00100000:2.0:1788638565.640687:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+10:2365:x1875523174223744:12345-192.168.203.34@tcp:4:bash.0 00000100:00100000:2.0:1788638565.641137:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+12:2365:x1875523174223744:12345-192.168.203.34@tcp:4:bash.0 Request processed in 449us (3524us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1788638565.641146:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 7 00002000:00100000:2.0:1788638565.641153:0:6690:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->7) req@ffff9c72826a1880 x1875523174223744/t4294967319(0) o4->00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp:541/0 lens 496/448 e 0 to 0 dl 1788638576 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788638565.641161:0:6690:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c72826a1880 with x1875523174223744 ext(0->7) 00002000:00010000:2.0:1788638565.641164:0:6690:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c72826a1880 00000100:00100000:1.0:1788638565.692566:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638565.692608:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174224128 00000100:00100000:1.0:1788638565.692618:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174224128 00000100:00100000:1.0:1788638565.692670:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 197 00000100:00100000:1.0:1788638565.692681:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+35:11574:x1875523174224128:12345-192.168.203.34@tcp:101:cat.0 00010000:00010000:1.0:1788638565.692705:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638565.692726:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b54f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14350e6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.692825:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b556 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.692848:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b556 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.692860:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b556 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.692874:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b55d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.692881:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b55d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.692889:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b55d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.693124:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b564 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.693135:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.693144:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788638565.693155:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788638565.693263:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b556 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.693272:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b556 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.693278:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b556 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.693291:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638565.693296:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b556 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.693305:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b556 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.693318:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:1.0:1788638565.693321:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638565.693326:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b556 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.693333:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b556 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.693348:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b55d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.693355:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b55d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.693362:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b55d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.693367:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638565.693370:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b55d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.693376:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b55d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.693394:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c7398420200) 00010000:00010000:1.0:1788638565.693397:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638565.693400:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b55d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.693406:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b55d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.693464:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b54f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350e6 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.693479:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b564 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350e6 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.693486:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:1.0:1788638565.693488:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788638565.693491:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385308c00, rc 0) 00000100:00100000:1.0:1788638565.693548:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad497b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+37:11574:x1875523174224128:12345-192.168.203.34@tcp:101:cat.0 Request processed in 869us (990us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788638565.693556:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 197 00000100:00100000:2.0:1788638565.700590:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638565.700675:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174224384 00000100:00100000:3.0:1788638565.700685:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174224384 00000100:00100000:3.0:1788638565.700744:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 54 00000100:00100000:3.0:1788638565.700755:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+37:11574:x1875523174224384:12345-192.168.203.34@tcp:35:cat.0 00000100:00100000:3.0:1788638565.704522:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+38:11574:x1875523174224384:12345-192.168.203.34@tcp:35:cat.0 Request processed in 3753us (3926us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788638565.704537:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 54 00000100:00100000:1.0:1788638565.714329:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+11:2365:x1875523174223872:12345-192.168.203.34@tcp:16:kworker.0 Request processed in 76427us (76637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638565.714343:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 60 00000001:00080000:1.0:1788638565.714381:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:1.0:1788638565.714391:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:1.0:1788638565.714398:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000100:00100000:1.0:1788638565.735631:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638565.735686:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174224640 00000100:00100000:3.0:1788638565.735696:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174224640 00000100:00100000:3.0:1788638565.735756:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 198 00000100:00100000:3.0:1788638565.735767:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+38:11575:x1875523174224640:12345-192.168.203.34@tcp:36:rm.0 00010000:00010000:3.0:1788638565.735861:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788638565.735889:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308c00/0xa0b1f1e3b4b2b564 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350e6 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.735912:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b53a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350df expref: 37 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.735927:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b502 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350d1 expref: 36 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.735937:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c73a1cf7a00) 00010000:00010000:3.0:1788638565.735947:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788638565.735966:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b572 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.735979:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b572 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.735996:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b572 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.736012:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b579 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.736020:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b579 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.736027:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b579 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.736279:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b580 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.736289:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b580 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.736296:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b580 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788638565.736897:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1788638565.736907:0:7634:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 328808123736ns, next at 329808121296ns, rc = 0 00010000:00010000:3.0:1788638565.736964:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b587 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.736974:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b587 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.736983:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b587 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.737003:0:7634:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b587 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.737009:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b587 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.737015:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b587 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.737038:0:7634:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788638565.737057:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b580 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.737062:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b580 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.737067:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b580 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.737073:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fd800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638565.737077:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b580 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.737084:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b580 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.737094:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7393e81700) 00010000:00010000:3.0:1788638565.737097:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788638565.737101:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b580 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.737117:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b580 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.737136:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b572 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.737142:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b572 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.737147:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b572 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.737152:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fc400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638565.737155:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b572 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.737161:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b572 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.737169:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:3.0:1788638565.737179:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638565.737182:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b572 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.737187:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b572 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788638565.737198:0:7634:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000098b67fd4 reply state 00000000cd8d1088 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b579 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638565.737206:0:7634:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788638565.737288:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad496680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+37:11575:x1875523174224640:12345-192.168.203.34@tcp:36:rm.0 Request processed in 1521us (1664us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788638565.737297:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 198 00010000:00010000:1.0:1788638565.737822:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638565.737829:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b587 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.737835:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031e00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638565.737839:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b587 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.737846:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b587 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.737861:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9c7393e81700) 00010000:00010000:1.0:1788638565.737863:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788638565.737867:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b587 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.737873:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b587 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.737888:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638565.737890:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638565.737891:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638565.739374:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b579 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.739387:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b579 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.739393:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b579 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.739399:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fd000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638565.739403:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b579 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.739421:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b579 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.739434:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c7393e81100) 00010000:00010000:1.0:1788638565.739437:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638565.739440:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b579 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638565.739446:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b579 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638565.779050:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638565.779122:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174224896 00000100:00100000:2.0:1788638565.779133:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174224896 00000100:00100000:2.0:1788638565.779277:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 199 00000100:00100000:2.0:1788638565.779292:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+36:11581:x1875523174224896:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:2.0:1788638565.779317:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638565.779337:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b58e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14350ed expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.779512:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b595 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.779527:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b595 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.779538:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b595 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.779551:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b59c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.779570:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b59c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.779577:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b59c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788638565.780637:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788638565.783637:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b5a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.783659:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.783673:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b5a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.784599:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b595 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.784612:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b595 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.784618:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b595 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.784624:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638565.784629:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b595 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.784637:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b595 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.784667:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:2.0:1788638565.784670:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638565.784675:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b595 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.784693:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b595 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788638565.784709:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024e9c0e1 reply state 00000000de84e850 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b59c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638565.784718:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788638565.784766:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b58e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ed expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.784837:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ed expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.784846:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c738a6e9d00) 00010000:00010000:2.0:1788638565.784849:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788638565.784851:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6000, rc 0) 00000100:00100000:2.0:1788638565.784917:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad494000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+39:11581:x1875523174224896:12345-192.168.203.34@tcp:101:bash.0 Request processed in 5629us (5875us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1788638565.784926:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 199 00010000:00010000:3.0:1788638565.788050:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b59c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.788067:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b59c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.788075:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b59c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.788082:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638565.788087:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b59c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.788094:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b59c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.788110:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c738a6e9300) 00010000:00010000:3.0:1788638565.788113:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638565.788118:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b59c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.788125:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b59c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638565.791416:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638565.791551:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174225024 00000100:00100000:2.0:1788638565.791564:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174225024 00000100:00100000:2.0:1788638565.791650:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 61 00000100:00100000:2.0:1788638565.791662:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2366:x1875523174225024:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:2.0:1788638565.791701:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638565.791726:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000003c526f8/0xa0b1f1e3b4b2b5b1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14350f4 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788638565.791758:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788638565.791801:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=328s v=(0 0) 00010000:00010000:2.0:1788638565.791806:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788638565.791825:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000003c526f8/0xa0b1f1e3b4b2b5b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350f4 expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.791847:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000003c526f8/0xa0b1f1e3b4b2b5b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350f4 expref: 6 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.791862:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6e00, rc 0) 00000100:00100000:2.0:1788638565.791926:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad494a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2366:x1875523174225024:12345-192.168.203.34@tcp:101:bash.0 Request processed in 265us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638565.791934:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 61 00000100:00080000:1.0:1788638565.792180:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788638565.794252:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638565.794901:0:11999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174225152 00000100:00100000:3.0:1788638565.794911:0:11999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174225152 00000100:00100000:3.0:1788638565.794972:0:11999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 62 00000100:00100000:3.0:1788638565.794983:0:11999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bba5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+6:11581:x1875523174225152:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:3.0:1788638565.795017:0:11999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638565.795035:0:11999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2b5b8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14350fb expref: -99 pid: 11999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.795068:0:11999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000003c526f8/0xa0b1f1e3b4b2b5b1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350f4 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.795078:0:11999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788638565.795082:0:11999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788638565.795088:0:11999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2b5b8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350fb expref: 7 pid: 11999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.795122:0:11999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000003c526f8/0xa0b1f1e3b4b2b5b1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350f4 expref: 7 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.795136:0:11999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000003c526f8/0xa0b1f1e3b4b2b5b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350f4 expref: 7 pid: 6687 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638565.795152:0:11999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738723e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11999:1875523183654656:192.168.203.34@tcp:104: 00000100:00100000:3.0:1788638565.795255:0:11999:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d90540 going to sleep for 11 seconds 00000100:00100000:0.0:1788638565.801216:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638565.801309:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174225280 00000100:00100000:2.0:1788638565.801318:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174225280 00010000:00010000:2.0:1788638565.801362:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000003c526f8/0xa0b1f1e3b4b2b5b1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350f4 expref: 8 pid: 6687 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638565.801410:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 76 00000100:00100000:2.0:1788638565.801420:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2365:x1875523174225280:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638565.801502:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638565.801538:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000003c526f8/0xa0b1f1e3b4b2b5b1 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350f4 expref: 8 pid: 6687 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.801551:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000003c526f8/0xa0b1f1e3b4b2b5b1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350f4 expref: 8 pid: 6687 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.801575:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788638565.801579:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788638565.801587:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2b5b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350fb expref: 8 pid: 11999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.801597:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2b5b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350fb expref: 8 pid: 11999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.801631:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2b5b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350fb expref: 8 pid: 11999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638565.801645:0:5827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7dc1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1875523183654784:192.168.203.34@tcp:105: 00000100:00100000:2.0:1788638565.801865:0:5827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bf2ad3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788638565.802188:0:11999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000003c526f8/0xa0b1f1e3b4b2b5b1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350f4 expref: 8 pid: 6687 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638565.802205:0:11999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738723e300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11999:1875523183654656:192.168.203.34@tcp:104: 00010000:00010000:3.0:1788638565.802232:0:11999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2b5b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350fb expref: 7 pid: 11999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.802254:0:11999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030000, rc 0) 00000100:00100000:3.0:1788638565.802290:0:11999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bba5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+7:11581:x1875523174225152:12345-192.168.203.34@tcp:101:bash.0 Request processed in 7309us (8047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638565.802298:0:11999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 62 00000100:00100000:2.0:1788638565.808014:0:5827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7dc1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5827:1875523183654784:192.168.203.34@tcp:105: 00010000:00010000:2.0:1788638565.808051:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638565.808112:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2365:x1875523174225280:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 6692us (6907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638565.808124:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 76 00000100:00100000:0.0:1788638565.809576:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638565.809659:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174225536 00000100:00100000:3.0:1788638565.809667:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174225536 00000100:00100000:3.0:1788638565.809721:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 55 00000100:00100000:3.0:1788638565.809731:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+38:11581:x1875523174225536:12345-192.168.203.34@tcp:35:bash.0 00000100:00100000:3.0:1788638565.810442:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+39:11581:x1875523174225536:12345-192.168.203.34@tcp:35:bash.0 Request processed in 709us (869us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788638565.810451:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 55 00000100:00100000:0.0:1788638565.980678:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638565.980822:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174225664 00000100:00100000:3.0:1788638565.980832:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174225664 00000100:00100000:3.0:1788638565.980891:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 200 00000100:00100000:3.0:1788638565.980901:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+39:11597:x1875523174225664:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:3.0:1788638565.980924:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638565.980943:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b5bf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435102 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.981008:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b5c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.981023:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.981037:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638565.981084:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788638565.981087:0:7634:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788638565.981103:0:7634:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b5c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.981127:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b5bf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435102 expref: 41 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.981146:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b5c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435102 expref: 40 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.981155:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:3.0:1788638565.981157:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788638565.981162:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030e00, rc 0) 00000100:00100000:3.0:1788638565.981234:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+40:11597:x1875523174225664:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 335us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638565.981242:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 200 00000100:00100000:1.0:1788638565.986530:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638565.988263:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174225920 00000100:00100000:2.0:1788638565.988276:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174225920 00000100:00100000:2.0:1788638565.988364:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 201 00000100:00100000:2.0:1788638565.988375:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+40:11597:x1875523174225920:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:2.0:1788638565.988397:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638565.988417:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b5cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435109 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.988516:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b5d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.988530:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.988543:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638565.988553:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788638565.988677:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b5cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435109 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.988696:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b5d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435109 expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638565.988705:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c738a6e9d00) 00010000:00010000:2.0:1788638565.988708:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788638565.988712:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6600, rc 0) 00000100:00100000:2.0:1788638565.988900:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad497480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+42:11597:x1875523174225920:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 525us (2377us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788638565.988907:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 201 00000100:00100000:2.0:1788638565.996391:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638565.996460:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638565.996652:0:11689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174226048 00000100:00100000:0.0:1788638565.996663:0:11689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174226048 00000100:00100000:0.0:1788638565.996739:0:11689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 15 00000100:00100000:3.0:1788638565.996905:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174226304 00000100:00100000:3.0:1788638565.996911:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174226304 00000100:00100000:3.0:1788638565.997014:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 202 00000100:00100000:3.0:1788638565.997024:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+43:11597:x1875523174226304:12345-192.168.203.34@tcp:101:lfs.0 00000100:00100000:0.0:1788638565.997118:0:11689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+43:2367:x1875523174226048:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788638565.997213:0:11689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638565.997245:0:11689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b5d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435109 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638565.997264:0:11689:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c738a6e9d00) 00010000:00010000:0.0:1788638565.997270:0:11689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788638565.997320:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638565.997339:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b5e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435110 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638565.997380:0:11689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+43:2367:x1875523174226048:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 631us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638565.997389:0:11689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 15 00010000:00010000:3.0:1788638565.997445:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b5e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.998365:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b5e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.998381:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b5e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638565.998397:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788638565.999306:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b5e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435110 expref: 44 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.999328:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b5e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435110 expref: 43 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638565.999336:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c738a6e9d00) 00010000:00010000:3.0:1788638565.999339:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788638565.999342:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031400, rc 0) 00000100:00100000:3.0:1788638565.999445:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+43:11597:x1875523174226304:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 2421us (2982us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788638565.999453:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 202 00000100:00100000:2.0:1788638566.006162:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638566.006264:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174226432 00000100:00100000:1.0:1788638566.006275:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174226432 00000100:00100000:1.0:1788638566.006330:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 63 00000100:00100000:1.0:1788638566.006340:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+6:2367:x1875523174226432:12345-192.168.203.34@tcp:1:lfs.0 00010000:00010000:1.0:1788638566.006381:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b5f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.006401:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2b5b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350fb expref: 6 pid: 11999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.006410:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788638566.006415:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788638566.006421:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b5f7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.006469:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2b5b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350fb expref: 6 pid: 11999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.006483:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2b5b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350fb expref: 6 pid: 11999 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638566.006498:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad495180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1875523183654912:192.168.203.34@tcp:104: 00000100:00100000:1.0:1788638566.006598:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bf2999c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638566.010092:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638566.010142:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad495180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6687:1875523183654912:192.168.203.34@tcp:104: 00010000:00010000:1.0:1788638566.010181:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b5f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638566.010407:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174226560 00000100:00100000:2.0:1788638566.010414:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174226560 00002000:00100000:2.0:1788638566.010696:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9c72826a3b80 x1875523174226560/t0(0) o4->00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp:542/0 lens 504/0 e 0 to 0 dl 1788638577 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788638566.010706:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c72826a3b80 with x1875523174226560 ext(0->8) 00010000:00010000:2.0:1788638566.010714:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2b5b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350fb expref: 7 pid: 11999 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.010729:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2b5b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350fb expref: 7 pid: 11999 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788638566.010737:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c72826a3b80 00000100:00100000:2.0:1788638566.011011:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 2 00000100:00100000:2.0:1788638566.011023:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2365:x1875523174226560:12345-192.168.203.34@tcp:4:lfs.0 00000100:00100000:2.0:1788638566.011716:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+9:2365:x1875523174226560:12345-192.168.203.34@tcp:4:lfs.0 Request processed in 693us (1630us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788638566.011725:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 2 00002000:00100000:2.0:1788638566.011733:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9c72826a3b80 x1875523174226560/t4294967308(0) o4->00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp:542/0 lens 504/448 e 0 to 0 dl 1788638577 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788638566.011742:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c72826a3b80 with x1875523174226560 ext(0->8) 00010000:00010000:2.0:1788638566.011758:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2b5b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350fb expref: 9 pid: 11999 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.011773:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2b5b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350fb expref: 9 pid: 11999 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788638566.011806:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9c72826a3b80 00000100:00100000:2.0:1788638566.017911:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638566.018560:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174226688 00000100:00100000:1.0:1788638566.018570:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174226688 00010000:00010000:1.0:1788638566.018620:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2b5b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350fb expref: 9 pid: 11999 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638566.018682:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 77 00000100:00100000:1.0:1788638566.018692:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+9:2366:x1875523174226688:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638566.018707:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788638566.018807:0:5828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788638566.018811:0:5828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788638566 00002000:00010000:1.0:1788638566.018813:0:5828:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788638566 00002000:00010000:1.0:1788638566.018815:0:5828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788638566 00010000:00010000:1.0:1788638566.018836:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2b5b8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350fb expref: 9 pid: 11999 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.018850:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2b5b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350fb expref: 9 pid: 11999 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.018875:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f55b2ef7/0xa0b1f1e3b4b2b5b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350fb expref: 9 pid: 11999 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.018893:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788638566.018896:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788638566.018902:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b5f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.018911:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b5f7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.018989:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788638566.019005:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b5f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.019014:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b5f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638566.019049:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2366:x1875523174226688:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 358us (1146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638566.019057:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 77 00010000:00010000:2.0:1788638566.019137:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b5f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.019144:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b5f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.019149:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b5f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.019153:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309800 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638566.019156:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b5f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.019163:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b5f7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.019183:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b5f7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.019200:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b5f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638566.019255:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2367:x1875523174226432:12345-192.168.203.34@tcp:1:lfs.0 Request processed in 12915us (13102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638566.019263:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 63 00000100:00100000:1.0:1788638566.023561:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638566.023641:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174226944 00000100:00100000:3.0:1788638566.023651:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174226944 00000100:00100000:3.0:1788638566.023715:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 56 00000100:00100000:3.0:1788638566.023724:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73a5715450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+43:11597:x1875523174226944:12345-192.168.203.34@tcp:35:lfs.0 00000004:00010000:3.0:1788638566.023830:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b5e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435110 expref: 43 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788638566.024076:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1788638566.024379:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1788638566.024666:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1788638566.025325:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b5fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.025344:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b5a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ed expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.025353:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b5fe lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.025388:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ed expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.025403:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b5a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ed expref: 47 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638566.025417:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738723e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1875523183655040:192.168.203.34@tcp:104: 00000100:00100000:3.0:1788638566.025503:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d90540 going to sleep for 11 seconds 00000100:00100000:3.0:1788638566.028201:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738723e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1875523183655040:192.168.203.34@tcp:104: 00000100:00100000:1.0:1788638566.028334:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638566.028694:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174227072 00000100:00100000:2.0:1788638566.028701:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174227072 00010000:00010000:2.0:1788638566.028736:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b5a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ed expref: 48 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638566.028809:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 78 00000100:00100000:2.0:1788638566.028819:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad495180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+48:2364:x1875523174227072:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638566.028833:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638566.028840:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b5a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ed expref: 48 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.028851:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b5fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.028855:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b5a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ed expref: 48 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.028890:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b5a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350ed expref: 48 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.028906:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c738a6e9d00) 00010000:00010000:2.0:1788638566.028912:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b5fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.028932:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b5fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.028939:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b5fe lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.030575:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788638566.030843:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b5fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638566.030843:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad495180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+47:2364:x1875523174227072:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 2018us (2503us total) trans 0 rc 0/0 00010000:00010000:3.0:1788638566.030861:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b5fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638566.030863:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 78 00000001:00080000:3.0:1788638566.031227:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1788638566.033152:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1788638566.033660:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738723e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875523183655168:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788638566.033734:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638566.034032:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183655168 00000100:00100000:0.0:1788638566.034042:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183655168 00000100:00100000:3.0:1788638566.034145:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d90300 going to sleep for 11 seconds 00000100:00100000:0.0:1788638566.034210:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788638566.034220:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1875523183655168:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788638566.034321:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1875523183655168:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 102us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638566.034330:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788638566.034403:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738723e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875523183655168:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788638566.034935:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1788638566.034996:0:5846:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738723e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875523183655296:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788638566.035028:0:5846:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638566.036577:0:5846:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d90540 going to sleep for 11 seconds 00000100:00100000:2.0:1788638566.036675:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183655296 00000100:00100000:2.0:1788638566.036684:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183655296 00000100:00100000:2.0:1788638566.036741:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788638566.036750:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1875523183655296:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788638566.037686:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5846:x1875523183655296:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 934us (2653us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788638566.037695:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788638566.043651:0:5846:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738723e300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1875523183655296:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788638566.043752:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:3.0:1788638566.043834:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b5fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.043844:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b5fe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.043853:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b5fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.043858:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638566.043863:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b5fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.043871:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b5fe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.043887:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c738a6e9d00) 00010000:00010000:3.0:1788638566.043963:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788638566.043983:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b5fe lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.043990:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b5fe lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788638566.044208:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788638566.044963:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1788638566.044977:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 329116193308ns, next at 330116190753ns, rc = 0 00000001:00080000:0.0:1788638566.044985:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1788638566.045028:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c738a6e9d00) 00010000:00010000:0.0:1788638566.045031:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788638566.045040:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b5e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435110 expref: 51 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638566.045163:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73a5715450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+50:11597:x1875523174226944:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 21438us (21610us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1788638566.045183:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 56 00000020:00080000:0.0:1788638566.045199:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788638566.048379:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638566.048529:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174227200 00000100:00100000:3.0:1788638566.048540:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174227200 00000100:00100000:3.0:1788638566.048603:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 203 00000100:00100000:3.0:1788638566.048612:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+50:11597:x1875523174227200:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:3.0:1788638566.048637:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638566.048671:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b605 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435117 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.048730:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b605 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435117 expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.048745:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b605 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435117 expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.048765:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:3.0:1788638566.048769:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788638566.048773:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030000, rc 0) 00000100:00100000:3.0:1788638566.048845:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+51:11597:x1875523174227200:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 234us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638566.048852:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 203 00000100:00100000:2.0:1788638566.052990:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638566.054143:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174227456 00000100:00100000:0.0:1788638566.054285:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174227456 00000100:00100000:0.0:1788638566.054418:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 57 00000100:00100000:0.0:1788638566.054429:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+51:11597:x1875523174227456:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:0.0:1788638566.054669:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+52:11597:x1875523174227456:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 240us (1686us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1788638566.054676:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 57 00000100:00100000:2.0:1788638566.112369:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788638566.112401:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7282ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183655424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788638566.112481:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638566.112537:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183655424 00000100:00100000:0.0:1788638566.112546:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183655424 00000100:00100000:0.0:1788638566.112598:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788638566.112608:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183655424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788638566.112630:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638566.112681:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183655424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638566.112688:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788638566.112742:0:3294:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:3.0:1788638566.112749:0:3294:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:3.0:1788638566.112818:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7282ffd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183655424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788638566.122470:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638566.122632:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174227584 00000100:00100000:3.0:1788638566.122641:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174227584 00000100:00100000:3.0:1788638566.122694:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 204 00000100:00100000:3.0:1788638566.122704:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+52:11607:x1875523174227584:12345-192.168.203.34@tcp:34:lfs.0 00010000:00010000:3.0:1788638566.122772:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b60c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.122812:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b60c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.122824:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b60c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.122839:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b613 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.122847:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.122854:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123095:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b61a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123104:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b61a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123111:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b61a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788638566.123176:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b61a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123190:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b60c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123196:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b60c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123202:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b60c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123207:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638566.123211:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b60c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123217:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b60c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123228:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:3.0:1788638566.123231:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638566.123236:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b60c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123241:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b60c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123252:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123258:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b613 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123271:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b613 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123276:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638566.123278:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b613 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123284:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b613 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123293:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c7393e81000) 00010000:00010000:3.0:1788638566.123295:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638566.123298:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b613 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123304:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b613 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123318:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b61a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123324:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b61a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123329:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b61a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123334:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638566.123336:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b61a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123353:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b61a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123361:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:3.0:1788638566.123363:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638566.123366:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b61a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.123371:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b61a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638566.123568:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+52:11607:x1875523174227584:12345-192.168.203.34@tcp:34:lfs.0 Request processed in 864us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638566.123578:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 204 00000001:00080000:1.0:1788638566.164324:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1788638566.164338:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1788638566.173002:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638566.173254:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174227840 00000100:00100000:3.0:1788638566.173265:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174227840 00000100:00100000:3.0:1788638566.173334:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 205 00000100:00100000:3.0:1788638566.173344:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+52:11610:x1875523174227840:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:3.0:1788638566.173365:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638566.173386:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b621 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143511e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.173461:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b628 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.173477:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b628 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.173489:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b628 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.173518:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b62f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.173527:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b62f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.173534:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b62f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.173651:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b636 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.173660:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.173952:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638566.173965:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788638566.174077:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b628 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.174085:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b628 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.174092:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b628 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.174097:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638566.174102:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b628 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.174123:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b628 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.174216:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:3.0:1788638566.174220:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638566.174225:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b628 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.174233:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2b628 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.174248:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b62f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.174255:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b62f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.174261:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b62f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.174267:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638566.174271:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b62f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.174408:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b62f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.174417:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c7393e81000) 00010000:00010000:3.0:1788638566.174419:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638566.174422:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b62f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.174448:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b62f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.174495:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b621 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143511e expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.174509:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b636 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143511e expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.174517:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:3.0:1788638566.174520:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788638566.174523:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73813fd000, rc 0) 00000100:00100000:3.0:1788638566.174589:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad495f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+54:11610:x1875523174227840:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 1245us (1593us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788638566.174598:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 205 00000100:00100000:2.0:1788638566.178666:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638566.178897:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174227968 00000100:00100000:3.0:1788638566.178908:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174227968 00000100:00100000:3.0:1788638566.178957:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 206 00000100:00100000:3.0:1788638566.178968:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+54:11610:x1875523174227968:12345-192.168.203.34@tcp:54:lfs.0 00010000:00010000:3.0:1788638566.179033:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b644 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.179050:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b644 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.179062:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b644 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.179105:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b644 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.179112:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b644 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.179119:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b644 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.179126:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fc400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638566.179130:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b644 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.179138:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b644 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.179151:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:3.0:1788638566.179153:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788638566.179158:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b644 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.179163:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b644 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638566.179282:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+54:11610:x1875523174227968:12345-192.168.203.34@tcp:54:lfs.0 Request processed in 315us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638566.179289:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 206 00000100:00100000:0.0:1788638566.184161:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638566.184252:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174228224 00000100:00100000:2.0:1788638566.184261:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174228224 00000100:00100000:2.0:1788638566.184353:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 58 00000100:00100000:2.0:1788638566.184363:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+54:11610:x1875523174228224:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:2.0:1788638566.185575:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+55:11610:x1875523174228224:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 1208us (1419us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1788638566.185585:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 58 00000100:00100000:3.0:1788638566.269245:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638566.269466:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174228480 00000100:00100000:2.0:1788638566.269476:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174228480 00000100:00100000:2.0:1788638566.269546:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 207 00000100:00100000:2.0:1788638566.269557:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7282ffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+55:11620:x1875523174228480:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:2.0:1788638566.269581:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638566.269584:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788638566.269611:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b5c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435102 expref: 55 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.269631:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:2.0:1788638566.269636:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788638566.269651:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2b64b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435125 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.269749:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b652 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.269763:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b636 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143511e expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.269771:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b652 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.269860:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b636 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143511e expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.269894:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b636 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143511e expref: 55 pid: 5844 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638566.269909:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7dc2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875523183655552:192.168.203.34@tcp:104: 00000100:00100000:2.0:1788638566.269992:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73866b19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638566.275674:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638566.276077:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7dc2300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1875523183655552:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638566.276227:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b652 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638566.279456:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174228608 00000100:00100000:0.0:1788638566.279471:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174228608 00010000:00010000:0.0:1788638566.279524:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b636 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143511e expref: 56 pid: 5844 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638566.279574:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 79 00000100:00100000:0.0:1788638566.279585:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+56:2364:x1875523174228608:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788638566.279599:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638566.279606:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b636 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143511e expref: 56 pid: 5844 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638566.279632:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b636 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143511e expref: 56 pid: 5844 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638566.279656:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b636 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143511e expref: 56 pid: 5844 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638566.279675:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:0.0:1788638566.279681:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b652 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638566.279691:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b652 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638566.279699:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b652 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638566.279735:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638566.279846:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+55:2364:x1875523174228608:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 262us (4183us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638566.279854:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 79 00010000:00010000:2.0:1788638566.281429:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b652 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.281446:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b652 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638566.281468:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788638566.281632:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2b64b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435125 expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.281652:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b652 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435125 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.281661:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:2.0:1788638566.281664:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788638566.281667:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6000, rc 0) 00000100:00100000:2.0:1788638566.281726:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7282ffd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+55:11620:x1875523174228480:12345-192.168.203.34@tcp:101:bash.0 Request processed in 12171us (12499us total) trans 4294967498 rc 0/0 00000100:00100000:2.0:1788638566.281750:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 207 00000100:00100000:3.0:1788638566.286389:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638566.292136:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174228864 00000100:00100000:2.0:1788638566.292151:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174228864 00000100:00100000:2.0:1788638566.292216:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 208 00000100:00100000:2.0:1788638566.292225:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+55:11620:x1875523174228864:12345-192.168.203.34@tcp:36:bash.0 00010000:00010000:2.0:1788638566.292469:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2b660 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.292485:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2b660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.292496:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2b660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788638566.292549:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1788638566.292569:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a9be943 reply state 00000000037b5bff transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2b660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638566.292578:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788638566.292665:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+58:11620:x1875523174228864:12345-192.168.203.34@tcp:36:bash.0 Request processed in 440us (6285us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788638566.292673:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 208 00000020:00080000:2.0:1788638566.292677:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788638566.295885:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2b660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.295925:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2b660 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.295934:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2b660 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.295941:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638566.295945:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2b660 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.295954:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2b660 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.295971:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:1.0:1788638566.295974:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638566.295979:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2b660 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.295986:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7800/0xa0b1f1e3b4b2b660 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638566.300100:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638566.300437:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174228992 00000100:00100000:2.0:1788638566.300448:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174228992 00000100:00100000:2.0:1788638566.300508:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 209 00000100:00100000:2.0:1788638566.300519:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+57:11620:x1875523174228992:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:2.0:1788638566.300544:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638566.300577:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b667 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143512c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.300668:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b66e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.300691:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b652 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435125 expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.300701:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b66e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.300740:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b652 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435125 expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.300753:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b652 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435125 expref: 58 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638566.300767:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7dc2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875523183655680:192.168.203.34@tcp:104: 00000100:00100000:2.0:1788638566.300893:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73866b19c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788638566.304529:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638566.304839:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7dc2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875523183655680:192.168.203.34@tcp:104: 00010000:00010000:3.0:1788638566.304869:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b66e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638566.307285:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638566.311371:0:11689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174229120 00000100:00100000:1.0:1788638566.311387:0:11689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174229120 00010000:00010000:1.0:1788638566.311437:0:11689:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b652 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435125 expref: 59 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638566.311483:0:11689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 80 00000100:00100000:1.0:1788638566.311493:0:11689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+59:2364:x1875523174229120:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638566.311516:0:11689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638566.311536:0:11689:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b652 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435125 expref: 59 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.311551:0:11689:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b652 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435125 expref: 59 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.311573:0:11689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b652 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435125 expref: 59 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.311592:0:11689:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:1.0:1788638566.311597:0:11689:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b66e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.311608:0:11689:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.311616:0:11689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b66e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.311650:0:11689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788638566.311883:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.311893:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638566.311937:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788638566.311942:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788638566.311963:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b66e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.311996:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b667 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143512c expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.312011:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b66e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143512c expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.312019:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:3.0:1788638566.312022:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788638566.312024:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6600, rc 0) 00000100:00100000:1.0:1788638566.312176:0:11689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+58:2364:x1875523174229120:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 674us (4890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638566.312185:0:11689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 80 00000100:00100000:3.0:1788638566.316911:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+57:11620:x1875523174228992:12345-192.168.203.34@tcp:101:bash.0 Request processed in 16380us (16808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638566.316925:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 209 00000100:00100000:0.0:1788638566.321219:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638566.321289:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174229376 00000100:00100000:3.0:1788638566.321298:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174229376 00000100:00100000:3.0:1788638566.321352:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 59 00000100:00100000:3.0:1788638566.321361:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+57:11620:x1875523174229376:12345-192.168.203.34@tcp:35:bash.0 00000100:00100000:3.0:1788638566.321592:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+58:11620:x1875523174229376:12345-192.168.203.34@tcp:35:bash.0 Request processed in 231us (382us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1788638566.321599:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 59 00000100:00100000:1.0:1788638566.405894:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638566.406094:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174229504 00000100:00100000:2.0:1788638566.406106:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174229504 00000100:00100000:2.0:1788638566.406176:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 210 00000100:00100000:2.0:1788638566.406188:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+58:11625:x1875523174229504:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:2.0:1788638566.406211:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638566.406235:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b675 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435133 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.406323:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b67c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.406340:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b67c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.406352:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b67c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638566.406388:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788638566.406391:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788638566.406408:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b67c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.406432:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b675 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435133 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.406451:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b67c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435133 expref: 59 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.406460:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:2.0:1788638566.406463:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788638566.406466:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6e00, rc 0) 00000100:00100000:2.0:1788638566.406545:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad497100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+59:11625:x1875523174229504:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 360us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638566.406553:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 210 00000100:00100000:0.0:1788638566.412948:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638566.413102:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174229632 00000100:00100000:1.0:1788638566.413111:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174229632 00000100:00100000:1.0:1788638566.413176:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 211 00000100:00100000:1.0:1788638566.413186:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+59:11625:x1875523174229632:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:1.0:1788638566.413205:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638566.413241:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b683 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143513a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413306:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b68a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413320:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b68a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413333:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b68a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413346:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b691 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413353:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b691 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413359:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b691 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413460:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b698 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413469:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b698 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413476:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b698 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788638566.413526:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788638566.413530:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788638566.413548:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b698 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413567:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b698 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413574:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b68a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413581:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b68a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413587:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b68a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413593:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638566.413597:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b68a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413605:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b68a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413617:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:1.0:1788638566.413620:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638566.413625:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b68a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413630:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b68a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413642:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b691 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413648:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b691 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413661:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b691 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413667:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638566.413670:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b691 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413677:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b691 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413685:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c7398420200) 00010000:00010000:1.0:1788638566.413688:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638566.413691:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b691 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413696:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309e00/0xa0b1f1e3b4b2b691 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413726:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309800/0xa0b1f1e3b4b2b683 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143513a expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413739:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b698 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143513a expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.413747:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:1.0:1788638566.413749:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788638566.413752:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385308000, rc 0) 00000100:00100000:1.0:1788638566.414225:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+60:11625:x1875523174229632:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 1038us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638566.414243:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 211 00000100:00100000:3.0:1788638566.419776:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638566.419843:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638566.419928:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174229888 00000100:00100000:2.0:1788638566.419938:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174229888 00000100:00100000:2.0:1788638566.420023:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 212 00000100:00100000:2.0:1788638566.420032:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+60:11625:x1875523174229888:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:2.0:1788638566.420051:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638566.420070:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b69f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435141 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.420164:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2b6a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.420192:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b66e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143512c expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.420201:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b698 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143513a expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.420209:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2b6a6 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.420239:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b698 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143513a expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.420250:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b698 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143513a expref: 61 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638566.420262:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7dc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875523183655808:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638566.420360:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b66e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143512c expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.420381:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b66e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143512c expref: 61 pid: 5844 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638566.420402:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7dc3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875523183655936:192.168.203.34@tcp:104: 00000100:00100000:2.0:1788638566.420429:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73866b1cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638566.420910:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174230016 00000100:00100000:0.0:1788638566.420917:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174230016 00010000:00010000:0.0:1788638566.420940:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b698 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143513a expref: 62 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638566.420978:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 81 00000100:00100000:0.0:1788638566.420994:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384df8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+62:2364:x1875523174230016:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788638566.421004:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638566.421010:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b698 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143513a expref: 62 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638566.421021:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b698 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143513a expref: 62 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638566.421038:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:0.0:1788638566.421043:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2b6a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638566.421049:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2b6a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638566.421055:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638566.421096:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384df8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+62:2364:x1875523174230016:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 104us (1330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638566.421104:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 81 00000100:00100000:3.0:1788638566.427844:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638566.427943:0:11689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174230144 00000100:00100000:1.0:1788638566.427953:0:11689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174230144 00010000:00010000:1.0:1788638566.428004:0:11689:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b66e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143512c expref: 62 pid: 5844 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638566.428050:0:11689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 82 00000100:00100000:1.0:1788638566.428061:0:11689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+62:2364:x1875523174230144:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638566.428077:0:11689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638566.428084:0:11689:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b66e lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143512c expref: 62 pid: 5844 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.428099:0:11689:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b66e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143512c expref: 62 pid: 5844 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.428123:0:11689:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:1.0:1788638566.428141:0:11689:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2b6a6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.428153:0:11689:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2b6a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.428162:0:11689:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2b6a6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.428193:0:11689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638566.428240:0:11689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+62:2364:x1875523174230144:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 181us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638566.428265:0:11689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 82 00010000:00010000:2.0:1788638566.432047:0:5843:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.34@tcp) returned -22 from blocking AST (req@000000005003b38b x1875523183655808) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b698 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143513a expref: 61 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.432072:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b698 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143513a expref: 61 pid: 5842 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638566.432091:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7dc0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875523183655808:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638566.432106:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b66e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143512c expref: 60 pid: 5844 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638566.432117:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7dc3800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875523183655936:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638566.432149:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:2.0:1788638566.432158:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2b6a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.432178:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2b6a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.432183:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2b6a6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638566.432220:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788638566.432356:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b69f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435141 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.432372:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2b6a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435141 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.432380:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:2.0:1788638566.432382:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788638566.432385:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7a00, rc 0) 00000100:00100000:2.0:1788638566.432476:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+60:11625:x1875523174229888:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 12445us (12631us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788638566.432486:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 212 00000100:00100000:3.0:1788638566.441549:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638566.441710:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174230400 00000100:00100000:0.0:1788638566.441719:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174230400 00000100:00100000:0.0:1788638566.441822:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 16 00000100:00100000:0.0:1788638566.441834:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+60:11625:x1875523174230400:12345-192.168.203.34@tcp:103:lfs.0 00010000:00010000:0.0:1788638566.441849:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638566.441876:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b605 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435117 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638566.441899:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:0.0:1788638566.441918:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638566.441989:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+59:11625:x1875523174230400:12345-192.168.203.34@tcp:103:lfs.0 Request processed in 158us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638566.441998:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 16 00000100:00100000:1.0:1788638566.444476:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638566.444564:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174230528 00000100:00100000:2.0:1788638566.444575:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174230528 00000100:00100000:2.0:1788638566.444628:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 213 00000100:00100000:2.0:1788638566.444638:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+59:11625:x1875523174230528:12345-192.168.203.34@tcp:58:lfs.0 00010000:00010000:2.0:1788638566.444740:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b6b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.444770:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b6b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.444824:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b6b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788638566.445024:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1788638566.445121:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad494380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+59:11625:x1875523174230528:12345-192.168.203.34@tcp:58:lfs.0 Request processed in 484us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638566.445142:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 213 00000100:00100000:2.0:1788638566.451038:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638566.451175:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174230656 00000100:00100000:3.0:1788638566.451186:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174230656 00000100:00100000:3.0:1788638566.451245:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 214 00000100:00100000:3.0:1788638566.451256:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+59:11625:x1875523174230656:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:3.0:1788638566.451275:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638566.451296:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b6bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435148 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.451356:0:7634:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b6b4 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.451366:0:7634:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b6bb lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435148 expref: 60 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.451397:0:7634:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b6b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.451429:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b6bb lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435148 expref: 60 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.451442:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:3.0:1788638566.451445:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788638566.451449:0:7634:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b6bb lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435148 expref: 60 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.451457:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73813fd800, rc 0) 00000100:00100000:3.0:1788638566.451526:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+60:11625:x1875523174230656:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 273us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638566.451532:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 214 00000040:00080000:2.0:1788638566.880037:0:11706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788638566.880047:0:11706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788638566.880087:0:11706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788638566.880112:0:11706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788638566.880245:0:11706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7dc0380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11706:1875523183656064:192.168.203.34@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788638566.880344:0:11706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384f669c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638566.886438:0:11706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7dc0380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11706:1875523183656064:192.168.203.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788638566.887485:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638566.887712:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174230784 00000100:00100000:2.0:1788638566.887720:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174230784 00000100:00100000:2.0:1788638566.887814:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 215 00000100:00100000:2.0:1788638566.887824:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+60:11627:x1875523174230784:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788638566.887855:0:5842:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788638566.887960:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad494700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+60:11627:x1875523174230784:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 Request processed in 137us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638566.887969:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 215 00000100:00100000:2.0:1788638566.897041:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638566.897716:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174230912 00000100:00100000:3.0:1788638566.897732:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174230912 00000100:00100000:3.0:1788638566.897837:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 216 00000100:00100000:3.0:1788638566.897848:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+60:11627:x1875523174230912:12345-192.168.203.34@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788638566.897920:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b6c2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.897937:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b6c2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.897949:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b6c2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.897965:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b6c9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.897984:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.897992:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898015:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b6d0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898025:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898031:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638566.898068:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788638566.898073:0:7634:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788638566.898085:0:7634:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898097:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b6c2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898103:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b6c2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898109:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b6c2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898115:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fc400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638566.898119:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b6c2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898150:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b6c2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898171:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c73a1cf7600) 00010000:00010000:3.0:1788638566.898175:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638566.898180:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b6c2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898186:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b6c2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898201:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b6c9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898207:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b6c9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898213:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898218:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fda00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638566.898222:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b6c9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898228:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b6c9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898235:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9c7393e81000) 00010000:00010000:3.0:1788638566.898237:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638566.898240:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b6c9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898256:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b6c9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898273:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b6d0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898279:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b6d0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898285:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b6d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898290:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fd000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638566.898293:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b6d0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898299:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b6d0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898307:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:3.0:1788638566.898310:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638566.898313:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b6d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.898318:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b6d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638566.898399:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+60:11627:x1875523174230912:12345-192.168.203.34@tcp:34:lhsmtool_posix.0 Request processed in 552us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638566.898407:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 216 00000100:00100000:0.0:1788638566.901545:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638566.901616:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174231168 00000100:00100000:2.0:1788638566.901625:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174231168 00000100:00100000:2.0:1788638566.901676:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 217 00000100:00100000:2.0:1788638566.901685:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+60:11627:x1875523174231168:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788638566.901705:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638566.901723:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b6d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143514f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.901870:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b6de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.901885:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b6de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.901906:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b6de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638566.901916:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788638566.901998:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b6de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.902006:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b6de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.902013:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b6de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.902018:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638566.902022:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b6de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.902030:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b6de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.902040:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:2.0:1788638566.902043:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788638566.902047:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b6de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.902063:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b6de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.902101:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b6d7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143514f expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.902110:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c73a1cf7600) 00010000:00010000:2.0:1788638566.902113:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788638566.902117:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b6d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143514f expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.902125:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7400, rc 0) 00000100:00100000:2.0:1788638566.902192:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+61:11627:x1875523174231168:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 508us (655us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1788638566.902200:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 217 00000100:00100000:1.0:1788638566.905646:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638566.905730:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174231296 00000100:00100000:3.0:1788638566.905750:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174231296 00000100:00100000:3.0:1788638566.905850:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 218 00000100:00100000:3.0:1788638566.905860:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+61:11627:x1875523174231296:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788638566.905894:0:7634:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788638566.905995:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad494a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+61:11627:x1875523174231296:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 Request processed in 136us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638566.906004:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 218 00000100:00100000:0.0:1788638566.913435:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638566.913516:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174231552 00000100:00100000:2.0:1788638566.913526:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174231552 00000100:00100000:2.0:1788638566.913577:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 219 00000100:00100000:2.0:1788638566.913586:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+61:11627:x1875523174231552:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788638566.913605:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638566.913608:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788638566.913631:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b67c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435133 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.913651:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:2.0:1788638566.913656:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788638566.913680:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b6ec lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435156 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788638566.914479:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1788638566.914684:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b6f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.914699:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.914710:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.914765:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b6ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435156 expref: 63 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.914823:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b6f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435156 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.914832:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c738a6e9000) 00010000:00010000:2.0:1788638566.914835:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788638566.914838:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6a00, rc 0) 00000100:00100000:2.0:1788638566.917845:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+62:11627:x1875523174231552:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 4247us (4406us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788638566.917858:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 219 00000100:00100000:0.0:1788638566.920966:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638566.921095:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174231808 00000100:00100000:2.0:1788638566.921106:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174231808 00000100:00100000:2.0:1788638566.921170:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 220 00000100:00100000:2.0:1788638566.921181:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+62:11627:x1875523174231808:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788638566.921259:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638566.921287:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b6f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435156 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.921304:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c738a6e9000) 00010000:00010000:2.0:1788638566.921329:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788638566.921349:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b701 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.921362:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b701 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.921371:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b701 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.921384:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b708 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x296c85b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.921391:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b708 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x296c85b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.921398:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b708 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x296c85b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.921754:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b701 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.921762:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b701 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.921768:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b701 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.921819:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638566.921824:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b701 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.921831:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b701 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.921841:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:2.0:1788638566.921843:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638566.921847:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b701 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.921853:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b701 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.921863:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b708 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x296c85b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.921868:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b708 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x296c85b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.921874:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b708 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x296c85b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.921879:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638566.921882:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b708 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x296c85b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.921899:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b708 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x296c85b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.921919:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x296c85b0 (ffff9c738a6e9800) 00010000:00010000:2.0:1788638566.921922:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638566.921925:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b708 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x296c85b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.921931:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b708 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x296c85b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638566.922066:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+61:11627:x1875523174231808:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 Request processed in 886us (1116us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788638566.922073:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 220 00000100:00100000:1.0:1788638566.929228:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638566.929318:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174231936 00000100:00100000:3.0:1788638566.929328:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174231936 00000100:00100000:3.0:1788638566.929384:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 221 00000100:00100000:3.0:1788638566.929394:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+61:11627:x1875523174231936:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788638566.929415:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638566.929439:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b70f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143515d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.929478:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b716 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.929492:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.929505:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.929623:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b70f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143515d expref: 63 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.929643:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b716 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143515d expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.929660:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c7393e81000) 00010000:00010000:3.0:1788638566.929663:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788638566.929667:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73813fda00, rc 0) 00000100:00100000:3.0:1788638566.929733:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad496d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+62:11627:x1875523174231936:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 340us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638566.929740:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 221 00000100:00100000:1.0:1788638566.936478:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638566.938259:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174232192 00000100:00100000:3.0:1788638566.938272:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174232192 00000100:00100000:3.0:1788638566.938338:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 222 00000100:00100000:3.0:1788638566.938348:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+62:11627:x1875523174232192:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788638566.938554:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b71d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.938572:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b71d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.938586:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b71d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788638566.938952:0:7634:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1788638566.938962:0:7634:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 330010178142ns, next at 331010175997ns, rc = 0 00000004:00010000:3.0:1788638566.939049:0:7634:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005f3801de reply state 000000009f68db59 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b71d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638566.939057:0:7634:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788638566.939179:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad495880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+64:11627:x1875523174232192:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 Request processed in 831us (2709us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1788638566.939205:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 222 00000100:00100000:0.0:1788638566.947484:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638566.947857:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174232320 00000100:00100000:2.0:1788638566.947868:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174232320 00000100:00100000:2.0:1788638566.947926:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 223 00000100:00100000:2.0:1788638566.947936:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+64:11627:x1875523174232320:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788638566.947957:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638566.947976:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b724 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435164 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.948032:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b724 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435164 expref: 65 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.948047:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b724 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435164 expref: 65 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.948066:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c7393e81000) 00010000:00010000:2.0:1788638566.948069:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788638566.948086:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6e00, rc 0) 00000100:00100000:2.0:1788638566.948159:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+65:11627:x1875523174232320:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 224us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638566.948175:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 223 00010000:00010000:3.0:1788638566.953730:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b71d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.953982:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b71d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.953991:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b71d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.953997:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fd000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638566.954002:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b71d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.954011:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b71d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.954028:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c7393e81000) 00010000:00010000:3.0:1788638566.954031:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788638566.954036:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b71d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.954043:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b71d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638566.959602:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638566.959685:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174232448 00000100:00100000:3.0:1788638566.959695:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174232448 00000100:00100000:3.0:1788638566.959766:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 64 00000100:00100000:3.0:1788638566.959776:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+9:2365:x1875523174232448:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1788638566.960405:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad495180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+10:2365:x1875523174232448:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 Request processed in 628us (809us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788638566.960432:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 64 00000100:00100000:0.0:1788638566.965374:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638566.965671:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174232704 00000100:00100000:3.0:1788638566.965681:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174232704 00000100:00100000:3.0:1788638566.965878:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 60 00000100:00100000:3.0:1788638566.965900:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+64:11627:x1875523174232704:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788638566.966235:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+65:11627:x1875523174232704:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 Request processed in 347us (869us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1788638566.966244:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 60 00000100:00100000:1.0:1788638566.973483:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638566.973556:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174232960 00000100:00100000:2.0:1788638566.973568:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174232960 00000100:00100000:2.0:1788638566.973622:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 224 00000100:00100000:2.0:1788638566.973632:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+65:11627:x1875523174232960:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788638566.973732:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4891f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+65:11627:x1875523174232960:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 Request processed in 101us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638566.973960:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 224 00000100:00100000:1.0:1788638566.979201:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638566.979282:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174233088 00000100:00100000:2.0:1788638566.979292:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174233088 00000100:00100000:2.0:1788638566.979373:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 225 00000100:00100000:2.0:1788638566.979382:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+65:11627:x1875523174233088:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788638566.979411:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638566.979431:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b72b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143516b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.979496:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b732 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.979510:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b732 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.979522:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b732 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638566.979557:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788638566.979590:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b732 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.979614:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b72b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143516b expref: 67 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.979633:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b732 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143516b expref: 66 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638566.979642:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c7393e81000) 00010000:00010000:2.0:1788638566.979645:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788638566.979648:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6a00, rc 0) 00000100:00100000:2.0:1788638566.979707:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4892680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+66:11627:x1875523174233088:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 326us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638566.979714:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 225 00000100:00100000:0.0:1788638566.982978:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638566.983057:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174233216 00000100:00100000:3.0:1788638566.983066:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174233216 00000100:00100000:3.0:1788638566.983124:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 65 00000100:00100000:3.0:1788638566.983142:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+10:2365:x1875523174233216:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788638566.983159:0:6684:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638566.983190:0:6684:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009028b34/0xa0b1f1e3b4b2b739 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435172 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788638566.983216:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c7567, blocks: 0x1 00010000:00010000:3.0:1788638566.983236:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=330s v=(0 0) 00010000:00010000:3.0:1788638566.983240:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788638566.983250:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009028b34/0xa0b1f1e3b4b2b739 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435172 expref: 11 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.983268:0:6684:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009028b34/0xa0b1f1e3b4b2b739 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435172 expref: 11 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638566.983301:0:6684:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73813fd000, rc 0) 00000100:00100000:3.0:1788638566.983361:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+11:2365:x1875523174233216:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 219us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638566.983368:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 65 00000100:00100000:0.0:1788638566.987304:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638566.987434:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174233472 00000100:00100000:3.0:1788638566.987445:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174233472 00000100:00100000:3.0:1788638566.987505:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 226 00000100:00100000:3.0:1788638566.987515:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+66:11627:x1875523174233472:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788638566.987625:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+66:11627:x1875523174233472:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 Request processed in 110us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638566.987632:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 226 00000100:00100000:0.0:1788638566.992636:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638566.992734:0:11999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174233600 00000100:00100000:1.0:1788638566.992743:0:11999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174233600 00000100:00100000:1.0:1788638566.996368:0:11999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 66 00000100:00100000:1.0:1788638566.996391:0:11999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+11:11627:x1875523174233600:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788638566.996410:0:11999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638566.996430:0:11999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b740 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435179 expref: -99 pid: 11999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.996462:0:11999:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009028b34/0xa0b1f1e3b4b2b739 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435172 expref: 12 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.996471:0:11999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638566.996474:0:11999:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638566.996480:0:11999:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b740 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435179 expref: 12 pid: 11999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.996519:0:11999:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009028b34/0xa0b1f1e3b4b2b739 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435172 expref: 12 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.996549:0:11999:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009028b34/0xa0b1f1e3b4b2b739 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435172 expref: 12 pid: 6684 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638566.996564:0:11999:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4658700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11999:1875523183656192:192.168.203.34@tcp:104: 00000100:00100000:1.0:1788638566.996744:0:11999:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bf299b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788638566.999081:0:11999:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4658700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11999:1875523183656192:192.168.203.34@tcp:104: 00010000:00010000:1.0:1788638566.999117:0:11999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b740 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435179 expref: 12 pid: 11999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638566.999148:0:11999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309800, rc 0) 00000100:00100000:1.0:1788638566.999212:0:11999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7da3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+12:11627:x1875523174233600:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 2831us (6586us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638566.999221:0:11999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 66 00000100:00100000:2.0:1788638567.000284:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638567.000465:0:11689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174233728 00000100:00100000:1.0:1788638567.000474:0:11689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174233728 00010000:00010000:1.0:1788638567.000507:0:11689:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009028b34/0xa0b1f1e3b4b2b739 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435172 expref: 12 pid: 6684 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638567.000578:0:11689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 83 00000100:00100000:1.0:1788638567.000588:0:11689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+12:2365:x1875523174233728:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638567.000602:0:11689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638567.000628:0:11689:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009028b34/0xa0b1f1e3b4b2b739 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435172 expref: 12 pid: 6684 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.000662:0:11689:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009028b34/0xa0b1f1e3b4b2b739 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435172 expref: 12 pid: 6684 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.000687:0:11689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009028b34/0xa0b1f1e3b4b2b739 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435172 expref: 12 pid: 6684 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.000703:0:11689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638567.000707:0:11689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638567.000716:0:11689:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b740 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435179 expref: 11 pid: 11999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.000728:0:11689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b740 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435179 expref: 11 pid: 11999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.000777:0:11689:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b740 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435179 expref: 11 pid: 11999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638567.000825:0:11689:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4658700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11689:1875523183656320:192.168.203.34@tcp:105: 00000100:00100000:1.0:1788638567.000893:0:11689:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bf299b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788638567.005981:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638567.006078:0:11689:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4658700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:11689:1875523183656320:192.168.203.34@tcp:105: 00010000:00010000:1.0:1788638567.006103:0:11689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638567.006176:0:11689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+11:2365:x1875523174233728:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 5590us (5898us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638567.006187:0:11689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 83 00000100:00100000:3.0:1788638567.006828:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174233856 00000100:00100000:3.0:1788638567.006836:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174233856 00002000:00100000:3.0:1788638567.006890:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9c7387dbc700 x1875523174233856/t0(0) o4->00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp:543/0 lens 504/0 e 0 to 0 dl 1788638578 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788638567.006901:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7387dbc700 with x1875523174233856 ext(0->12) 00002000:00010000:3.0:1788638567.006906:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c7387dbc700 00000100:00100000:3.0:1788638567.006925:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:3.0:1788638567.006934:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+11:2365:x1875523174233856:12345-192.168.203.34@tcp:4:lhsmtool_posix.0 00000100:00080000:1.0:1788638567.007012:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788638567.008897:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+13:2365:x1875523174233856:12345-192.168.203.34@tcp:4:lhsmtool_posix.0 Request processed in 1958us (2921us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788638567.008909:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 8 00002000:00100000:0.0:1788638567.008918:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9c7387dbc700 x1875523174233856/t4294967321(0) o4->00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp:543/0 lens 504/448 e 0 to 0 dl 1788638578 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788638567.008928:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c7387dbc700 with x1875523174233856 ext(0->12) 00002000:00010000:0.0:1788638567.008933:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c7387dbc700 00000100:00100000:0.0:1788638567.012490:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638567.012580:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174233984 00000100:00100000:1.0:1788638567.012590:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174233984 00000100:00100000:1.0:1788638567.012665:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 227 00000100:00100000:1.0:1788638567.012675:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+66:11627:x1875523174233984:12345-192.168.203.34@tcp:44:lhsmtool_posix.0 00000100:00080000:2.0:1788638567.013878:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1788638567.045352:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967495 is committed 00000020:00080000:0.0:1788638567.045480:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c728304a000 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1788638567.045486:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7387dd5600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c728304a540 00000020:00080000:0.0:1788638567.045490:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7387dd5a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c7388735800 00000020:00080000:2.0:1788638567.045557:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 6 committed batchid 5 00000020:00080000:2.0:1788638567.045735:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000001:00080000:0.0:1788638567.045947:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967504 is committed 00000100:00100000:3.0:1788638567.046283:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+43:11627:x1875523174233984:12345-192.168.203.34@tcp:44:lhsmtool_posix.0 Request processed in 33604us (33798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638567.046293:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 227 00000001:00080000:0.0:1788638567.048455:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1788638567.048473:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000004:00080000:0.0:1788638567.048500:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1788638567.048520:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c7384d90300 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1788638567.048524:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7281c16500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c7384d90c00 00000020:00080000:0.0:1788638567.048527:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7281c16800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c73bf6ebc00 00000004:00080000:0.0:1788638567.048553:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000020:00080000:0.0:1788638567.048580:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1788638567.048642:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788638567.048938:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387d9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183656448:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788638567.049009:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638567.049062:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387d9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183656576:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788638567.049084:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638567.049114:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183656448 00000100:00100000:0.0:1788638567.049121:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183656448 00000100:00100000:0.0:1788638567.049187:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183656576 00000100:00100000:0.0:1788638567.049191:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183656576 00000100:00100000:0.0:1788638567.049212:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788638567.049221:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3294:x1875523183656448:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788638567.049245:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1788638567.049270:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8e2bcc0/0xa0b1f1e3b4b2b747 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638567.049292:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000808447a6/0xa0b1f1e3b4b2b509 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350d8 expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638567.049302:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788638567.049318:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788638567.049323:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8e2bcc0/0xa0b1f1e3b4b2b747 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638567.049351:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000808447a6/0xa0b1f1e3b4b2b509 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350d8 expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638567.049366:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000808447a6/0xa0b1f1e3b4b2b509 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350d8 expref: 12 pid: 6687 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638567.049379:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c45c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1875523183656704:192.168.203.34@tcp:104: 00000100:00100000:3.0:1788638567.049634:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788638567.049649:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3291:x1875523183656576:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788638567.049809:0:6684:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788638567.049813:0:6684:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788638567 00002000:00010000:3.0:1788638567.049815:0:6684:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788638567.049817:0:6684:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788638567 -> 1788638567 00002000:00010000:3.0:1788638567.049820:0:6684:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788638567.049859:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3291:x1875523183656576:12345-0@lo:2:osp-syn-1-0.0 Request processed in 211us (773us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788638567.049866:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1788638567.050003:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1788638567.050041:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c7387d9f100/2, rc 0, transno 4294967322 00000100:00100000:2.0:1788638567.050047:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387d9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183656576:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788638567.050055:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788638567.050061:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183656832:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788638567.050090:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638567.050221:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183656832 00000100:00100000:3.0:1788638567.050226:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183656832 00000100:00100000:3.0:1788638567.050264:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788638567.050271:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183656832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788638567.050283:0:6684:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1788638567.050304:0:6684:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c7566, atime: 0x6a9c7566, ctime: 0x6a9c7566, blocks: 0xb 00010000:00010000:3.0:1788638567.050310:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d5a4507/0xa0b1f1e3b4b2b74e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.050320:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=330s v=(0 0) 00010000:00010000:3.0:1788638567.050324:0:6684:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788638567.050330:0:6684:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d5a4507/0xa0b1f1e3b4b2b74e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.050344:0:6684:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d5a4507/0xa0b1f1e3b4b2b74e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.050354:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d5a4507/0xa0b1f1e3b4b2b74e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.050369:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d5a4507/0xa0b1f1e3b4b2b74e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.050383:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788638567.050952:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3291:x1875523183656832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 680us (860us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788638567.050960:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00010000:2.0:1788638567.051031:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638567.051037:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d5a4507/0xa0b1f1e3b4b2b74e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.051056:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fc400 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638567.051061:0:7639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d5a4507/0xa0b1f1e3b4b2b74e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.051070:0:7639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d5a4507/0xa0b1f1e3b4b2b74e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.051087:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d5a4507/0xa0b1f1e3b4b2b74e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.051095:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d5a4507/0xa0b1f1e3b4b2b74e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.051117:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638567.051119:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638567.051121:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788638567.051137:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788638567.051172:0:3291:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1788638567.051178:0:3291:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c73acdca300, transno 4294967307 00000004:00080000:2.0:1788638567.051193:0:3291:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:2.0:1788638567.051214:0:3291:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c73b7dc1500 x1875523183656832/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788638583 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788638567.051224:0:3291:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c73b7dc1500/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788638567.051228:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7dc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183656832:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788638567.051607:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638567.051711:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638567.054436:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174234112 00000100:00100000:3.0:1788638567.054450:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174234112 00000100:00100000:3.0:1788638567.054512:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 70 00000100:00100000:3.0:1788638567.054522:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+13:2366:x1875523174234112:12345-192.168.203.34@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788638567.059722:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638567.059758:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174234240 00000100:00100000:0.0:1788638567.059765:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174234240 00010000:00010000:0.0:1788638567.059819:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000808447a6/0xa0b1f1e3b4b2b509 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350d8 expref: 14 pid: 6687 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638567.059853:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 84 00000100:00100000:0.0:1788638567.059862:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+14:2365:x1875523174234240:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788638567.059875:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638567.059881:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000808447a6/0xa0b1f1e3b4b2b509 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350d8 expref: 14 pid: 6687 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638567.059894:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000808447a6/0xa0b1f1e3b4b2b509 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350d8 expref: 14 pid: 6687 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638567.059932:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788638567.059937:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788638567.059944:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c8e2bcc0/0xa0b1f1e3b4b2b747 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638567.059954:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8e2bcc0/0xa0b1f1e3b4b2b747 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638567.059973:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638567.060021:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c44000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+14:2365:x1875523174234240:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 160us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638567.060028:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 84 00010000:00010000:3.0:1788638567.060564:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000808447a6/0xa0b1f1e3b4b2b509 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350d8 expref: 13 pid: 6687 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638567.060583:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c45c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1875523183656704:192.168.203.34@tcp:104: 00010000:00010000:3.0:1788638567.060607:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c8e2bcc0/0xa0b1f1e3b4b2b747 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.060618:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c8e2bcc0/0xa0b1f1e3b4b2b747 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.060625:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8e2bcc0/0xa0b1f1e3b4b2b747 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.060651:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8e2bcc0/0xa0b1f1e3b4b2b747 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.060658:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8e2bcc0/0xa0b1f1e3b4b2b747 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.060686:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788638567.061307:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398bfad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3294:x1875523183656448:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12085us (12296us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1788638567.061317:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:0.0:1788638567.062090:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638567.062099:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8e2bcc0/0xa0b1f1e3b4b2b747 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638567.062109:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c600 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638567.062114:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8e2bcc0/0xa0b1f1e3b4b2b747 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638567.062136:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8e2bcc0/0xa0b1f1e3b4b2b747 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638567.062156:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8e2bcc0/0xa0b1f1e3b4b2b747 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638567.062188:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8e2bcc0/0xa0b1f1e3b4b2b747 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638567.062209:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638567.062211:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638567.062212:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788638567.062252:0:3294:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c7387d9ed80/2, rc 0, transno 4294967323 00000100:00100000:0.0:1788638567.062259:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387d9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183656448:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788638567.083298:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4658700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+12:2366:x1875523174234112:12345-192.168.203.34@tcp:16:lhsmtool_posix.0 Request processed in 28768us (31579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638567.083312:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 70 00000001:00080000:0.0:1788638567.085932:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:0.0:1788638567.085967:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:1.0:1788638567.086549:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638567.086640:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174234496 00000100:00100000:3.0:1788638567.086649:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174234496 00000100:00100000:3.0:1788638567.086752:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 228 00000100:00100000:3.0:1788638567.086763:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b465bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+20:11627:x1875523174234496:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788638567.086837:0:7634:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638567.086865:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b732 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143516b expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.086887:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c7393e81000) 00010000:00010000:3.0:1788638567.086894:0:7634:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788638567.086926:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b755 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.086952:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b755 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.086963:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b755 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788638567.087276:0:7634:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000998083ad reply state 00000000b7ffad59 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b755 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638567.087286:0:7634:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788638567.087379:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b465bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+21:11627:x1875523174234496:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 Request processed in 617us (833us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788638567.087386:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 228 00000100:00100000:0.0:1788638567.090217:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638567.090835:0:11999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174234624 00000100:00100000:3.0:1788638567.090846:0:11999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174234624 00000100:00100000:3.0:1788638567.090894:0:11999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 71 00000100:00100000:3.0:1788638567.090903:0:11999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2364:x1875523174234624:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788638567.091115:0:11999:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788638567.091118:0:11999:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788638567 -> 1788638566 00002000:00010000:3.0:1788638567.091121:0:11999:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788638566 00002000:00010000:3.0:1788638567.091132:0:11999:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788638567 -> 1788638566 00002000:00010000:3.0:1788638567.091135:0:11999:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788638567.091202:0:11999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2364:x1875523174234624:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 Request processed in 300us (995us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788638567.091212:0:11999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 71 00010000:00010000:1.0:1788638567.093403:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b755 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.093422:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b755 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.093431:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b755 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.093437:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fc400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638567.093442:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b755 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.093450:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b755 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.093468:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c7393e81000) 00010000:00010000:1.0:1788638567.093472:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638567.093477:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b755 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.093484:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b755 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638567.093905:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638567.094038:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174234880 00000100:00100000:3.0:1788638567.094047:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174234880 00000100:00100000:3.0:1788638567.094108:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 229 00000100:00100000:3.0:1788638567.094118:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+20:11627:x1875523174234880:12345-192.168.203.34@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788638567.094207:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b75c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.094221:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b716 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143515d expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.094229:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b75c lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.094263:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b716 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143515d expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.094277:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b716 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143515d expref: 20 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638567.094291:0:5844:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387d9dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875523183656960:192.168.203.34@tcp:104: 00000100:00100000:3.0:1788638567.094368:0:5844:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7d8be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788638567.097299:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638567.097539:0:5844:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387d9dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1875523183656960:192.168.203.34@tcp:104: 00010000:00010000:0.0:1788638567.097567:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b75c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638567.098065:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174235008 00000100:00100000:1.0:1788638567.098073:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174235008 00010000:00010000:1.0:1788638567.098108:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b716 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143515d expref: 21 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638567.098253:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 85 00000100:00100000:1.0:1788638567.098264:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+21:2364:x1875523174235008:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638567.098278:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638567.098285:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b716 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143515d expref: 21 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.098298:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b716 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143515d expref: 21 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.098318:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fda00/0xa0b1f1e3b4b2b716 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143515d expref: 21 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.098336:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c7393e81000) 00010000:00010000:1.0:1788638567.098342:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b75c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.098351:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b75c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.098358:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b75c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.098429:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638567.098487:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+20:2364:x1875523174235008:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 225us (1196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638567.098507:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 85 00010000:00010000:3.0:1788638567.099562:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b75c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.099573:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b75c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.099604:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b75c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.099611:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b75c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.099632:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b75c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.099639:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fd000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638567.099643:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b75c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.099652:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b75c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.099664:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c7393e81000) 00010000:00010000:3.0:1788638567.099668:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788638567.099672:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b75c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.099678:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd000/0xa0b1f1e3b4b2b75c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638567.099864:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4899500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+19:11627:x1875523174234880:12345-192.168.203.34@tcp:55:lhsmtool_posix.0 Request processed in 5746us (5960us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788638567.099873:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 229 00000100:00100000:3.0:1788638567.102705:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638567.102963:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174235136 00000100:00100000:0.0:1788638567.102973:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174235136 00000100:00100000:0.0:1788638567.103028:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 72 00000100:00100000:0.0:1788638567.103038:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2365:x1875523174235136:12345-192.168.203.34@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788638567.103079:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b763 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638567.103100:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b740 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435179 expref: 8 pid: 11999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638567.103140:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638567.103145:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788638567.103150:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b763 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638567.103199:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b740 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435179 expref: 8 pid: 11999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638567.103214:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b740 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435179 expref: 8 pid: 11999 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638567.103229:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1875523183657088:192.168.203.34@tcp:104: 00000100:00100000:0.0:1788638567.103442:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788638567.107090:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638567.107330:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c46a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6687:1875523183657088:192.168.203.34@tcp:104: 00010000:00010000:1.0:1788638567.107357:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b763 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638567.108047:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174235264 00000100:00100000:0.0:1788638567.108055:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174235264 00010000:00010000:0.0:1788638567.108093:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b740 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435179 expref: 9 pid: 11999 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638567.108222:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 86 00000100:00100000:0.0:1788638567.108231:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+9:2364:x1875523174235264:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788638567.108247:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638567.108270:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b740 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435179 expref: 9 pid: 11999 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638567.108299:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b740 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435179 expref: 9 pid: 11999 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638567.108322:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2b740 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435179 expref: 9 pid: 11999 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638567.108338:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788638567.108342:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788638567.108347:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b763 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638567.108358:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b763 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638567.108391:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638567.108450:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2364:x1875523174235264:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 219us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638567.108458:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 86 00010000:00010000:2.0:1788638567.108506:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b763 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.108516:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b763 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.108539:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b763 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.108547:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b763 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.108555:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b763 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.108562:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638567.108566:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b763 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.108575:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b763 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.108587:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b763 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.108595:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b763 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638567.108658:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2365:x1875523174235136:12345-192.168.203.34@tcp:1:lhsmtool_posix.0 Request processed in 5621us (5962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638567.108666:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 72 00000100:00100000:2.0:1788638567.110877:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638567.110974:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174235520 00000100:00100000:3.0:1788638567.110982:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174235520 00000100:00100000:3.0:1788638567.111030:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 230 00000100:00100000:3.0:1788638567.111039:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+19:11627:x1875523174235520:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788638567.111116:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b76a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.111155:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b76a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.111175:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b76a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.111383:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b771 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.111394:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b724 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435164 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.111403:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b771 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.111437:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b724 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435164 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.111451:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b724 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435164 expref: 20 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638567.111465:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdca300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875523183657216:192.168.203.34@tcp:104: 00000100:00100000:3.0:1788638567.111540:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7d8be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788638567.114214:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638567.114343:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdca300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875523183657216:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638567.114369:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b771 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638567.114930:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174235648 00000100:00100000:1.0:1788638567.114939:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174235648 00010000:00010000:1.0:1788638567.114977:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b724 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435164 expref: 21 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638567.115050:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 87 00000100:00100000:1.0:1788638567.115060:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dfa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+21:2365:x1875523174235648:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638567.115073:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638567.115079:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b724 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435164 expref: 21 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.115092:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b724 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435164 expref: 21 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.115114:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b724 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435164 expref: 21 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.115232:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c7393e81000) 00010000:00010000:1.0:1788638567.115237:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b771 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.115265:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b771 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.115272:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b771 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.115294:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638567.115350:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dfa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+20:2365:x1875523174235648:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 291us (1147us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638567.115358:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 87 00010000:00010000:1.0:1788638567.115553:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b771 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.115561:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b771 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788638567.116993:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:1.0:1788638567.117268:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:1.0:1788638567.117314:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:1.0:1788638567.117397:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b489ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1875523183657344:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788638567.117682:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638567.117763:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bf299f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788638567.117969:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183657344 00000100:00100000:0.0:1788638567.117977:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183657344 00000100:00100000:0.0:1788638567.118053:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788638567.118063:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b489a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1875523183657344:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788638567.118221:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b489a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1875523183657344:12345-0@lo:1000:mdt00_001.0 Request processed in 158us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638567.118229:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788638567.118309:0:5843:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:1.0:1788638567.118315:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c7387d9f100, transno 4294967322 00000100:00100000:1.0:1788638567.118337:0:5843:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9c7387d9ed80 x1875523183656448/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788638583 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638567.118349:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b489ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1875523183657344:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788638567.118920:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:1.0:1788638567.118988:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b489ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1875523183657472:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788638567.119024:0:5843:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638567.119759:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bf299b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788638567.119924:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183657472 00000100:00100000:2.0:1788638567.119933:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183657472 00000100:00100000:2.0:1788638567.119970:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788638567.119978:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1875523183657472:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1788638567.120191:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4898a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5843:x1875523183657472:12345-0@lo:1000:mdt00_001.0 Request processed in 212us (1164us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788638567.120199:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788638567.120351:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b489ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1875523183657472:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788638567.120386:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b771 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.120397:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b771 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.120404:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b771 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.120411:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638567.120415:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b771 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.120423:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b771 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.120437:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c7393e81000) 00010000:00010000:1.0:1788638567.120440:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788638567.120445:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b771 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.120452:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030000/0xa0b1f1e3b4b2b771 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.120481:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b6b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.120488:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b6b4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.120503:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b6b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.120508:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638567.120511:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b6b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.120517:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b6b4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.120526:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:1.0:1788638567.120528:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788638567.120535:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b6bb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435148 expref: 23 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.120547:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b6bb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435148 expref: 23 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.120556:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b6bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435148 expref: 23 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.120587:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b6bb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435148 expref: 23 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638567.120600:0:5843:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4899880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875523183657600:192.168.203.34@tcp:105: 00000100:00100000:1.0:1788638567.120672:0:5843:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bf299b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788638567.123694:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638567.123718:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174235776 00000100:00100000:3.0:1788638567.123725:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174235776 00000100:00100000:3.0:1788638567.123780:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 61 00000100:00100000:3.0:1788638567.123808:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+24:11625:x1875523174235776:12345-192.168.203.34@tcp:49:lfs.0 00000100:00100000:3.0:1788638567.123938:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+24:11625:x1875523174235776:12345-192.168.203.34@tcp:49:lfs.0 Request processed in 131us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638567.123946:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 61 00000100:00100000:3.0:1788638567.123993:0:5843:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4899880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1875523183657600:192.168.203.34@tcp:105: 00010000:00010000:3.0:1788638567.124015:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b6b4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.124026:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2b6b4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.124058:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b778 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.124071:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b778 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.124082:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b778 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.124090:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b778 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.124095:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b778 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.124102:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b778 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.124107:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638567.124111:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b778 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.124135:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b778 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.124147:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:3.0:1788638567.124150:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638567.124154:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b778 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.124160:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b778 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.124181:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b76a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.124188:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b76a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.124193:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b76a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.124198:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fc400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638567.124201:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b76a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.124206:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b76a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.124213:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:3.0:1788638567.124215:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788638567.124218:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b76a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.124233:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc400/0xa0b1f1e3b4b2b76a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788638567.124487:0:11706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788638567.124492:0:11706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788638567.125001:0:11706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788638567.125009:0:11706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788638567.125084:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+23:11627:x1875523174235520:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 Request processed in 14043us (14213us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1788638567.125094:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 230 00000020:00080000:3.0:1788638567.125099:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788638567.130519:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638567.130602:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638567.130679:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174236032 00000100:00100000:1.0:1788638567.130688:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174236032 00000100:00100000:1.0:1788638567.130769:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 231 00000100:00100000:1.0:1788638567.130779:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+23:11625:x1875523174236032:12345-192.168.203.34@tcp:58:lfs.0 00000040:00080000:1.0:1788638567.131304:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1788638567.131435:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+23:11625:x1875523174236032:12345-192.168.203.34@tcp:58:lfs.0 Request processed in 656us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638567.131444:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 231 00000100:00100000:3.0:1788638567.131618:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174236288 00000100:00100000:3.0:1788638567.131625:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174236288 00000100:00100000:3.0:1788638567.131666:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 62 00000100:00100000:3.0:1788638567.131675:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73a5717450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+23:11627:x1875523174236288:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788638567.132566:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788638567.132672:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1788638567.132723:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b77f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.133045:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b77f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.133061:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b77f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.133070:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b77f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.133089:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b77f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.133095:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b77f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.133170:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788638567.133253:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73a5717450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+25:11627:x1875523174236288:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 Request processed in 1577us (2649us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1788638567.133262:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 62 00000020:00080000:3.0:1788638567.133266:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788638567.142247:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638567.142263:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b77f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.142274:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031400 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638567.142279:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b77f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.142289:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b77f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.142307:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9c7393e81600) 00010000:00010000:1.0:1788638567.142310:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788638567.142314:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b77f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.142321:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031400/0xa0b1f1e3b4b2b77f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638567.142339:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638567.142341:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638567.142343:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638567.160606:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638567.160711:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174236416 00000100:00100000:2.0:1788638567.160721:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174236416 00000100:00100000:2.0:1788638567.160775:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 232 00000100:00100000:2.0:1788638567.160821:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+25:11629:x1875523174236416:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:2.0:1788638567.160844:0:7634:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638567.160864:0:7634:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b786 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435180 expref: -99 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.160926:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b78d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.160958:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b78d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.160970:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b78d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.160985:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b794 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.160991:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.160998:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.161344:0:7634:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b79b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.161356:0:7634:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2b6a6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435141 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.161365:0:7634:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b79b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.161398:0:7634:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2b6a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435141 expref: 26 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.161411:0:7634:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2b6a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435141 expref: 26 pid: 5843 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638567.161445:0:7634:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7dc1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7634:1875523183657728:192.168.203.34@tcp:104: 00000100:00100000:2.0:1788638567.161520:0:7634:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73a0ae30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638567.164841:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638567.164927:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174236672 00000100:00100000:0.0:1788638567.164936:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174236672 00000100:00100000:0.0:1788638567.164995:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 63 00000100:00100000:0.0:1788638567.165005:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+27:9975:x1875523174236672:12345-192.168.203.34@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788638567.165247:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+28:9975:x1875523174236672:12345-192.168.203.34@tcp:35:ldlm_bl.0 Request processed in 242us (415us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788638567.165255:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 63 00000100:00100000:3.0:1788638567.166230:0:7634:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7dc1180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7634:1875523183657728:192.168.203.34@tcp:104: 00010000:00010000:3.0:1788638567.166257:0:7634:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b79b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638567.168488:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638567.169286:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174236800 00000100:00100000:3.0:1788638567.169297:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174236800 00010000:00010000:2.0:1788638567.169474:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2b6a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435141 expref: 28 pid: 5843 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638567.169550:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 88 00000100:00100000:2.0:1788638567.169559:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+28:2364:x1875523174236800:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638567.169574:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638567.169580:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2b6a6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435141 expref: 28 pid: 5843 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.169591:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2b6a6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435141 expref: 28 pid: 5843 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.169612:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2b6a6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435141 expref: 28 pid: 5843 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.169627:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:2.0:1788638567.169632:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b79b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.169641:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b79b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.169648:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b79b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638567.169689:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638567.169752:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+27:2364:x1875523174236800:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 194us (1273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638567.169759:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 88 00010000:00010000:3.0:1788638567.170107:0:7634:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b79b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.170116:0:7634:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b79b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638567.170175:0:7634:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788638567.170180:0:7634:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788638567.170199:0:7634:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b79b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.170213:0:7634:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b79b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.170234:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b78d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.170241:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b78d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.170247:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b78d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.170252:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7000 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638567.170256:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b78d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.170264:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b78d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.170274:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:3.0:1788638567.170276:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638567.170279:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b78d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.170285:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b78d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.170295:0:7634:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.170301:0:7634:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b794 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.170306:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b794 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.170319:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638567.170321:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b794 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.170328:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b794 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.170336:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9c738a6e9800) 00010000:00010000:3.0:1788638567.170338:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638567.170341:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b794 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.170346:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6c00/0xa0b1f1e3b4b2b794 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7634 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.170380:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b786 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435180 expref: 27 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.170394:0:7634:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b79b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435180 expref: 26 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638567.170401:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:3.0:1788638567.170403:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788638567.170406:0:7634:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6400, rc 0) 00000100:00100000:3.0:1788638567.170457:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4899f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+26:11629:x1875523174236416:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 9673us (9861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638567.170464:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 232 00010000:00010000:1.0:1788638567.329652:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788638567.970121:0:12539:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788638567.970130:0:12539:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788638567.970270:0:12539:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788638567.970276:0:12539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:3.0:1788638568.160030:0:11706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788638568.160049:0:11706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788638568.160078:0:11706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788638568.160083:0:11706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788638568.160380:0:11706:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73acdca300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11706:1875523183657856:192.168.203.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788638568.160711:0:11706:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73b7d8bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788638568.165661:0:11706:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73acdca300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11706:1875523183657856:192.168.203.34@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788638568.167254:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638568.167415:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174236928 00000100:00100000:0.0:1788638568.167425:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174236928 00000100:00100000:0.0:1788638568.167472:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 233 00000100:00100000:0.0:1788638568.167480:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+26:11641:x1875523174236928:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788638568.167511:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788638568.167598:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4899880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+26:11641:x1875523174236928:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 Request processed in 118us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638568.167605:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 233 00000100:00100000:1.0:1788638568.172642:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638568.172757:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174237184 00000100:00100000:3.0:1788638568.172766:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174237184 00000100:00100000:3.0:1788638568.172886:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 234 00000100:00100000:3.0:1788638568.172903:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+26:11641:x1875523174237184:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788638568.172922:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638568.172944:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b7a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435187 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638568.173205:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b7a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638568.173221:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b7a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638568.173234:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b7a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638568.173245:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788638568.173359:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b7a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435187 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638568.173376:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b7a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435187 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638568.173401:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:3.0:1788638568.173403:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788638568.173407:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030e00, rc 0) 00000100:00100000:3.0:1788638568.173458:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+28:11641:x1875523174237184:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 563us (831us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788638568.173465:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 234 00000100:00100000:2.0:1788638568.179014:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638568.179301:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174237312 00000100:00100000:1.0:1788638568.179312:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174237312 00000100:00100000:1.0:1788638568.179380:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 17 00000100:00100000:1.0:1788638568.179390:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+28:2367:x1875523174237312:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638568.179404:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638568.179428:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030e00/0xa0b1f1e3b4b2b7a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435187 expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638568.179448:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:1.0:1788638568.179453:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638568.179516:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+27:2367:x1875523174237312:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 126us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638568.179523:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 17 00000100:00100000:2.0:1788638568.180048:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638568.183273:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174237568 00000100:00100000:0.0:1788638568.183288:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174237568 00000100:00100000:0.0:1788638568.183400:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 235 00000100:00100000:0.0:1788638568.183422:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+27:11641:x1875523174237568:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788638568.183519:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b7b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638568.183537:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b7b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638568.183566:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b7b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638568.183756:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b7b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638568.183764:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b7b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638568.183771:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b7b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638568.183777:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01da00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638568.183797:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b7b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638568.183806:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b7b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638568.183819:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:0.0:1788638568.183822:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788638568.183827:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b7b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638568.183833:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b7b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638568.183992:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+28:11641:x1875523174237568:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 Request processed in 581us (3944us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788638568.184000:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 235 00000040:00080000:2.0:1788638568.184175:0:11706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788638568.184179:0:11706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788638568.184668:0:11706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788638568.184676:0:11706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788638568.187754:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638568.187905:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174237824 00000100:00100000:0.0:1788638568.187914:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174237824 00000100:00100000:0.0:1788638568.187960:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 64 00000100:00100000:0.0:1788638568.187968:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+28:11641:x1875523174237824:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788638568.188364:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+29:11641:x1875523174237824:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 Request processed in 395us (618us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1788638568.188372:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 64 00010000:00010000:0.0:1788638568.351909:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638568.672543:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788638568.672565:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183657984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788638568.672632:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638568.672768:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183657984 00000100:00100000:0.0:1788638568.672801:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183657984 00000100:00100000:0.0:1788638568.672854:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788638568.672863:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738723e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1875523183657984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788638568.672912:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638568.672964:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738723e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3294:x1875523183657984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 102us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638568.672971:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788638568.673605:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183657984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788638568.717703:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638568.717752:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638568.717846:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638568.717874:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638568.718075:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174237952 00000100:00100000:0.0:1788638568.718085:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174237952 00000100:00100000:0.0:1788638568.718135:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 300 00000100:00100000:0.0:1788638568.718146:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+13:2366:x1875523174237952:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638568.718238:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383680c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+13:2366:x1875523174237952:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 87us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638568.718247:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174238336 00000100:00100000:0.0:1788638568.718247:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 300 00000100:00100000:1.0:1788638568.718254:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174238336 00000100:00100000:1.0:1788638568.718315:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 161 00000100:00100000:1.0:1788638568.718325:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2366:x1875523174238336:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638568.718361:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2366:x1875523174238336:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 40us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638568.718368:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 161 00000100:00080000:1.0:1788638568.718388:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638568.718732:0:11999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174238080 00000100:00100000:2.0:1788638568.718737:0:11999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174238080 00000100:00100000:2.0:1788638568.718832:0:11999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174238208 00000100:00100000:2.0:1788638568.718836:0:11999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174238208 00000100:00100000:2.0:1788638568.718862:0:11999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 94 00000100:00100000:2.0:1788638568.718870:0:11999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2366:x1875523174238080:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638568.719069:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 95 00000100:00100000:0.0:1788638568.719078:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2366:x1875523174238208:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638568.719117:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2366:x1875523174238208:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 40us (1241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638568.719139:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 95 00000100:00100000:2.0:1788638568.719232:0:11999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2366:x1875523174238080:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 362us (1539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638568.719240:0:11999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 94 00000100:00080000:3.0:1788638568.719449:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788638569.381694:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788638569.628284:0:12590:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788638569.628293:0:12590:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788638569.628350:0:12590:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788638569.628357:0:12590:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788638569.769541:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638569.769744:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174238592 00000100:00100000:1.0:1788638569.769754:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174238592 00000100:00100000:1.0:1788638569.769865:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 236 00000100:00100000:1.0:1788638569.769875:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+29:11662:x1875523174238592:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:1.0:1788638569.769900:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638569.769920:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b7be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143518e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638569.770015:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b7c5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638569.770031:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b7c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638569.770045:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b7c5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788638569.770055:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788638569.770181:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308000/0xa0b1f1e3b4b2b7be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143518e expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638569.770199:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b7c5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143518e expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638569.770207:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:1.0:1788638569.770210:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788638569.770214:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309000, rc 0) 00000100:00100000:1.0:1788638569.770270:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+31:11662:x1875523174238592:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 397us (739us total) trans 4294967519 rc 0/0 00000100:00100000:1.0:1788638569.770278:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 236 00000100:00080000:3.0:1788638569.770363:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788638569.774388:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638569.774584:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174238720 00000100:00100000:3.0:1788638569.774593:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174238720 00000100:00100000:3.0:1788638569.774650:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 237 00000100:00100000:3.0:1788638569.774661:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+31:11662:x1875523174238720:12345-192.168.203.34@tcp:54:lfs.0 00010000:00010000:3.0:1788638569.774729:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b7d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638569.774746:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638569.774769:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638569.774833:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b7d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638569.774841:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b7d3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638569.774847:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b7d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638569.774852:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638569.774855:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b7d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638569.774862:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b7d3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638569.774873:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:3.0:1788638569.774876:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788638569.774881:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b7d3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638569.774886:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031a00/0xa0b1f1e3b4b2b7d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638569.774948:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+31:11662:x1875523174238720:12345-192.168.203.34@tcp:54:lfs.0 Request processed in 289us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638569.774956:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 237 00000100:00100000:2.0:1788638569.891415:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638569.891814:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174238848 00000100:00100000:0.0:1788638569.891823:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174238848 00000100:00100000:0.0:1788638569.891895:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 73 00000100:00100000:0.0:1788638569.891906:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2366:x1875523174238848:12345-192.168.203.34@tcp:101:cat.0 00010000:00010000:0.0:1788638569.891924:0:6686:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1788638569.892013:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788638569.892068:0:6686:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005f672074/0xa0b1f1e3b4b2b7da lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435195 expref: -99 pid: 6686 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788638569.892095:0:6686:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9c7566, atime: 0x6a9c7566, ctime: 0x6a9c7566, blocks: 0xb 00010000:00010000:0.0:1788638569.892113:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=332s v=(0 0) 00010000:00010000:0.0:1788638569.892118:0:6686:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638569.892126:0:6686:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005f672074/0xa0b1f1e3b4b2b7da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435195 expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638569.892151:0:6686:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005f672074/0xa0b1f1e3b4b2b7da lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435195 expref: 8 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638569.892165:0:6686:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01ce00, rc 0) 00000100:00100000:0.0:1788638569.892242:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2366:x1875523174238848:12345-192.168.203.34@tcp:101:cat.0 Request processed in 338us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638569.892249:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 73 00000100:00100000:0.0:1788638569.897625:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638569.897712:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174238976 00000100:00100000:2.0:1788638569.897724:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174238976 00002000:00100000:2.0:1788638569.897774:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9c73b7c44000 x1875523174238976/t0(0) o3->00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp:545/0 lens 488/0 e 0 to 0 dl 1788638580 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788638569.897869:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c73b7c44000 with x1875523174238976 ext(0->4095) 00002000:00010000:2.0:1788638569.897876:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c73b7c44000 00000100:00100000:2.0:1788638569.897914:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:2.0:1788638569.897924:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2366:x1875523174238976:12345-192.168.203.34@tcp:3:cat.0 00000100:00100000:2.0:1788638569.898301:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:00196f64-ae55-4ffc-b84c-468028ab3a77+8:2366:x1875523174238976:12345-192.168.203.34@tcp:3:cat.0 Request processed in 370us (675us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1788638569.898309:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 9 00002000:00100000:2.0:1788638569.898317:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9c73b7c44000 x1875523174238976/t0(0) o3->00196f64-ae55-4ffc-b84c-468028ab3a77@192.168.203.34@tcp:545/0 lens 488/4536 e 0 to 0 dl 1788638580 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788638569.898324:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9c73b7c44000 with x1875523174238976 ext(0->4095) 00002000:00010000:2.0:1788638569.898327:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9c73b7c44000 00010000:00010000:1.0:1788638570.399995:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638570.721340:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183658112:0@lo:400:kworker.0 00000100:00100000:3.0:1788638570.721459:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638570.721532:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183658240:0@lo:400:kworker.0 00000100:00100000:3.0:1788638570.721550:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad39d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183658624:0@lo:400:kworker.0 00000100:00100000:2.0:1788638570.721584:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638570.721615:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183658752:0@lo:400:kworker.0 00000100:00100000:3.0:1788638570.721628:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183658240 00000100:00100000:3.0:1788638570.721640:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183658240 00000100:00100000:2.0:1788638570.721645:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638570.721670:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788638570.721677:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183658368:0@lo:400:kworker.0 00000100:00100000:3.0:1788638570.721708:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788638570.721726:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bc076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183658240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638570.721810:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bc076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183658240:12345-0@lo:400:kworker.0 Request processed in 86us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638570.721819:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788638570.721869:0:11999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183658752 00000100:00100000:3.0:1788638570.721873:0:11999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183658752 00000100:00100000:3.0:1788638570.721916:0:11999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788638570.721923:0:11999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3291:x1875523183658752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638570.721959:0:11999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb7a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3291:x1875523183658752:12345-0@lo:400:kworker.0 Request processed in 37us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638570.721966:0:11999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:3.0:1788638570.721984:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788638570.722178:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183658496:0@lo:400:kworker.0 00000100:00100000:1.0:1788638570.722215:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638570.722277:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638570.722308:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183658496 00000100:00100000:3.0:1788638570.722314:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183658496 00000100:00100000:0.0:1788638570.722380:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183658112 00000100:00100000:2.0:1788638570.722383:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183658240:0@lo:400:kworker.0 00000100:00100000:0.0:1788638570.722402:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183658112 00000100:00100000:2.0:1788638570.722412:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183658752:0@lo:400:kworker.0 00000100:00100000:0.0:1788638570.722454:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788638570.722464:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183658112:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788638570.722467:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788638570.722486:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638570.722512:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383683850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183658112:12345-0@lo:400:kworker.0 Request processed in 51us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638570.722520:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1788638570.722612:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7c46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183658112:0@lo:400:kworker.0 00000100:00100000:2.0:1788638570.722673:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788638570.722683:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3293:x1875523183658496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638570.722766:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183658368 00000100:00100000:1.0:1788638570.722771:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183658368 00000100:00100000:3.0:1788638570.722812:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183658624 00000100:00100000:3.0:1788638570.722819:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183658624 00000100:00080000:1.0:1788638570.722844:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638570.722858:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788638570.722868:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183658624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638570.722956:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00080000:1.0:1788638570.722957:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638570.722968:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183658368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638570.723047:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183658624:12345-0@lo:400:kworker.0 Request processed in 180us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638570.723054:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788638570.723088:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad39d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183658624:0@lo:400:kworker.0 00000100:00100000:2.0:1788638570.723180:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3293:x1875523183658496:12345-0@lo:400:kworker.0 Request processed in 498us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638570.723192:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788638570.723365:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183658496:0@lo:400:kworker.0 00000100:00100000:0.0:1788638570.727197:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183658368:12345-0@lo:400:kworker.0 Request processed in 4217us (5478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638570.727216:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788638570.727363:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183658368:0@lo:400:kworker.0 00000100:00100000:0.0:1788638571.233058:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638571.233091:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183658880:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788638571.233197:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638571.233277:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183658880 00000100:00100000:0.0:1788638571.233287:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183658880 00000100:00100000:0.0:1788638571.233350:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788638571.233360:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1875523183658880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788638571.233403:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638571.233454:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3291:x1875523183658880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638571.233462:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788638571.233928:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183658880:0@lo:13:osp-pre-1-0.0 00000001:00080000:3.0:1788638571.313427:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:0.0:1788638571.424159:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788638572.329496:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:0.0:1788638572.329522:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:0.0:1788638572.329540:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1788638572.329552:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9c73bf299f00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1788638572.329557:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7387dd5f00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9c73bf2999c0 00000020:00080000:0.0:1788638572.329562:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9c7387dd5300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9c7384dce800 00000020:00080000:0.0:1788638572.329579:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 6 batchid updated 00000020:00080000:0.0:1788638572.329624:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788638572.329886:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1788638572.345241:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:3.0:1788638572.345267:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00010000:00010000:1.0:1788638572.448107:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638573.478547:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638573.792175:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183659008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788638573.792247:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638573.792760:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183659008 00000100:00100000:0.0:1788638573.792769:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183659008 00000100:00100000:0.0:1788638573.792854:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00080000:1.0:1788638573.792859:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788638573.792867:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183659008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788638573.792904:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638573.792965:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183659008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (717us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638573.793009:0:3293:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788638573.793015:0:3293:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c73b7dc1500, transno 4294967310 00000100:00100000:1.0:1788638573.793031:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183659008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788638573.793415:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788638573.827373:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638573.827913:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638573.827959:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174239232 00000100:00100000:3.0:1788638573.827972:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174239232 00000100:00100000:3.0:1788638573.828057:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 165 00000100:00100000:3.0:1788638573.828069:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c72826a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+18:2367:x1875523174239232:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638573.828249:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c72826a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+18:2367:x1875523174239232:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 182us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638573.828257:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 165 00000100:00080000:3.0:1788638573.828381:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638573.829893:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638573.829952:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638573.829972:0:11999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174239488 00000100:00100000:2.0:1788638573.829988:0:11999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174239488 00000100:00100000:0.0:1788638573.829988:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174239104 00000100:00100000:0.0:1788638573.829997:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174239104 00000100:00100000:3.0:1788638573.830003:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638573.830051:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174239360 00000100:00100000:3.0:1788638573.830061:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174239360 00000100:00100000:2.0:1788638573.830070:0:11999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 98 00000100:00100000:0.0:1788638573.830071:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 302 00000100:00100000:2.0:1788638573.830094:0:11999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2366:x1875523174239488:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638573.830094:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+13:2367:x1875523174239104:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638573.830188:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383683c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+13:2367:x1875523174239104:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 107us (2831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638573.830196:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 302 00000100:00100000:3.0:1788638573.830264:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 99 00000100:00100000:3.0:1788638573.830277:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2366:x1875523174239360:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638573.831439:0:11999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7dc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2366:x1875523174239488:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 1350us (1549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638573.831448:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2366:x1875523174239360:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 1171us (1497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638573.831465:0:11999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 98 00000100:00100000:0.0:1788638573.831676:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174239616 00000100:00100000:0.0:1788638573.831684:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174239616 00000100:00100000:0.0:1788638573.831730:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 166 00000100:00100000:0.0:1788638573.831740:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2366:x1875523174239616:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638573.831822:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:2366:x1875523174239616:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 83us (1823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638573.831830:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 166 00000100:00080000:0.0:1788638573.831848:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788638573.831853:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788638573.831855:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788638573.831935:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 99 00000100:00100000:3.0:1788638574.298859:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638574.298988:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174239744 00000100:00100000:0.0:1788638574.299001:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174239744 00000100:00100000:0.0:1788638574.299081:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 238 00000100:00100000:0.0:1788638574.299091:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+18:11307:x1875523174239744:12345-192.168.203.34@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788638574.299330:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+18:11307:x1875523174239744:12345-192.168.203.34@tcp:60:lhsmtool_posix.0 Request processed in 240us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638574.299339:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 238 00000100:00100000:2.0:1788638574.302289:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638574.303234:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174240000 00000100:00100000:0.0:1788638574.303250:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174240000 00000100:00100000:0.0:1788638574.303335:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 65 00000100:00100000:0.0:1788638574.303348:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+18:11307:x1875523174240000:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788638574.304874:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+19:11307:x1875523174240000:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 Request processed in 1519us (2591us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788638574.304887:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 65 00000040:00080000:3.0:1788638574.368582:0:11706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788638574.368591:0:11706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788638574.368895:0:11706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1788638574.368907:0:11706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788638574.496031:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638574.534151:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638574.534500:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174240128 00000100:00100000:2.0:1788638574.534527:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174240128 00000100:00100000:2.0:1788638574.534615:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 239 00000100:00100000:2.0:1788638574.534629:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdbf9a9f-afb3-447e-b3b7-3039526706d5+5:12113:x1875523174240128:12345-192.168.203.34@tcp:101:lsof.0 00010000:00010000:2.0:1788638574.534664:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638574.534694:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b7e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143519c expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638574.534837:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b7e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638574.534879:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638574.534896:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638574.534950:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788638574.534955:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788638574.534980:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b7e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638574.535013:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b7e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143519c expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638574.535036:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b7e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143519c expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638574.535046:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7398420a00) 00010000:00010000:2.0:1788638574.535050:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788638574.535055:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6a00, rc 0) 00000100:00100000:2.0:1788638574.535158:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:cdbf9a9f-afb3-447e-b3b7-3039526706d5+6:12113:x1875523174240128:12345-192.168.203.34@tcp:101:lsof.0 Request processed in 532us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638574.535178:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 239 00010000:00010000:1.0:1788638575.520231:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638575.842336:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183659136:0@lo:400:kworker.0 00000100:00100000:2.0:1788638575.842448:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638575.843590:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183659136 00000100:00100000:0.0:1788638575.843610:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183659136 00000100:00100000:0.0:1788638575.843683:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788638575.843694:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183659136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638575.844027:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788638575.844046:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183659264:0@lo:400:kworker.0 00000100:00100000:3.0:1788638575.844114:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638575.844160:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183659264 00000100:00100000:3.0:1788638575.844164:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183659264 00000100:00100000:3.0:1788638575.844201:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788638575.844209:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183659264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638575.844253:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183659264:12345-0@lo:400:kworker.0 Request processed in 45us (139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638575.844262:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788638575.844315:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183659264:0@lo:400:kworker.0 00000100:00100000:3.0:1788638575.844357:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183659392:0@lo:400:kworker.0 00000100:00100000:3.0:1788638575.844382:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638575.844464:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183659520:0@lo:400:kworker.0 00000100:00100000:1.0:1788638575.844522:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638575.844586:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183659392 00000100:00100000:1.0:1788638575.844590:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183659392 00000100:00100000:1.0:1788638575.844629:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788638575.844636:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183659392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638575.844692:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183659392:12345-0@lo:400:kworker.0 Request processed in 57us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638575.844699:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788638575.844727:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183659392:0@lo:400:kworker.0 00000100:00080000:1.0:1788638575.844749:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788638575.844811:0:11999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183659520 00000100:00100000:1.0:1788638575.844814:0:11999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183659520 00000100:00100000:1.0:1788638575.844845:0:11999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788638575.844852:0:11999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad39d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183659520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638575.844889:0:11999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad39d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183659520:12345-0@lo:400:kworker.0 Request processed in 37us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638575.844896:0:11999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00080000:1.0:1788638575.844910:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788638575.845272:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183659520:0@lo:400:kworker.0 00000100:00100000:0.0:1788638575.845422:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383680450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183659136:12345-0@lo:400:kworker.0 Request processed in 1728us (2973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638575.845441:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788638575.845699:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788638575.845711:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183659776:0@lo:400:kworker.0 00000100:00100000:1.0:1788638575.845760:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638575.845818:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788638575.845826:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183659648:0@lo:400:kworker.0 00000100:00100000:1.0:1788638575.845866:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638575.845893:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183659648 00000100:00100000:1.0:1788638575.845898:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183659648 00000100:00100000:1.0:1788638575.845936:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788638575.845944:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183659648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638575.845996:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183659648:12345-0@lo:400:kworker.0 Request processed in 53us (129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638575.846015:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:1.0:1788638575.846032:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788638575.846055:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183659648:0@lo:400:kworker.0 00000100:00100000:3.0:1788638575.846291:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183659776 00000100:00100000:3.0:1788638575.846296:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183659776 00000100:00100000:3.0:1788638575.846342:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788638575.846350:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4f24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183659776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638575.846391:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4f24380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183659776:12345-0@lo:400:kworker.0 Request processed in 42us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638575.846398:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:1.0:1788638575.846584:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788638575.846606:0:3292:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:1.0:1788638575.846613:0:3292:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c7387d9ed80, transno 4294967323 00000004:00080000:1.0:1788638575.846632:0:3292:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:1.0:1788638575.846653:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183659776:0@lo:400:kworker.0 00000100:00100000:2.0:1788638575.847463:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183659136:0@lo:400:kworker.0 00000100:00100000:1.0:1788638576.353563:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad30ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183659904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788638576.353689:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638576.355903:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183659904 00000100:00100000:2.0:1788638576.355945:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183659904 00000100:00100000:2.0:1788638576.356036:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788638576.356049:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183659904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788638576.356112:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788638576.359345:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183659904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3281us (5640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638576.359363:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788638576.361996:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad30ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183659904:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788638576.544254:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788638577.430387:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1788638577.430408:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1788638577.430442:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788638577.430453:0:5875:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:02000400:3.0:1788638577.455571:0:12793:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 16:02:56 (1788638576) 00010000:00010000:1.0:1788638577.573145:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638578.592078:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638578.913500:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73ad6c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183660032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788638578.913572:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638578.913613:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183660032 00000100:00100000:3.0:1788638578.913621:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183660032 00000100:00080000:2.0:1788638578.913656:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788638578.913756:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788638578.913767:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183660032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788638578.913830:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788638578.913879:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7c45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183660032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638578.913887:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788638578.914103:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73ad6c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183660032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788638578.947543:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638578.947583:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638578.947620:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638578.947683:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174240256 00000100:00100000:0.0:1788638578.947693:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174240256 00000100:00100000:0.0:1788638578.947752:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 304 00000100:00100000:0.0:1788638578.947762:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:2365:x1875523174240256:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638578.947868:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383683050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:55273f9a-386c-4321-9748-c194b047efe8+13:2365:x1875523174240256:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 107us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638578.947878:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 304 00000100:00100000:1.0:1788638578.948175:0:11999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174240512 00000100:00100000:1.0:1788638578.948180:0:11999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174240512 00000100:00100000:1.0:1788638578.948222:0:11999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 102 00000100:00100000:1.0:1788638578.948229:0:11999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2365:x1875523174240512:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638578.948262:0:11999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2365:x1875523174240512:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 33us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638578.948269:0:11999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 102 00000100:00100000:1.0:1788638578.948289:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174240768 00000100:00100000:1.0:1788638578.948292:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174240768 00000100:00100000:1.0:1788638578.948343:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 170 00000100:00100000:1.0:1788638578.948350:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdbf9a9f-afb3-447e-b3b7-3039526706d5+6:2365:x1875523174240768:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638578.948375:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:cdbf9a9f-afb3-447e-b3b7-3039526706d5+6:2365:x1875523174240768:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 27us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638578.948381:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 170 00000100:00080000:1.0:1788638578.948502:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788638578.948506:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788638578.951860:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638578.951896:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638578.951944:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174240640 00000100:00100000:3.0:1788638578.951957:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174240640 00000100:00100000:3.0:1788638578.952009:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 103 00000100:00100000:3.0:1788638578.952021:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2364:x1875523174240640:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638578.952098:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2364:x1875523174240640:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 81us (201us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638578.952107:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 103 00000100:00100000:1.0:1788638578.953648:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174240384 00000100:00100000:1.0:1788638578.953722:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174240384 00000100:00100000:1.0:1788638578.953816:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 171 00000100:00100000:1.0:1788638578.953826:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+18:2364:x1875523174240384:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638578.953895:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+18:2364:x1875523174240384:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 72us (2044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638578.953903:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 171 00000100:00080000:1.0:1788638578.954339:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788638578.954343:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788638579.619138:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638580.645995:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638580.960034:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387d9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183660160:0@lo:400:kworker.0 00000100:00100000:2.0:1788638580.960122:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638580.960138:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183660288:0@lo:400:kworker.0 00000100:00100000:1.0:1788638580.960172:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638580.960173:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788638580.960178:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183660544:0@lo:400:kworker.0 00000100:00100000:1.0:1788638580.960195:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788638580.960201:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183660416:0@lo:400:kworker.0 00000100:00100000:2.0:1788638580.960203:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638580.960221:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638580.960238:0:11999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183660544 00000100:00100000:2.0:1788638580.960245:0:11999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183660544 00000100:00100000:1.0:1788638580.960247:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183660288 00000100:00100000:1.0:1788638580.960249:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183660288 00000100:00100000:1.0:1788638580.960282:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183660416 00000100:00100000:1.0:1788638580.960284:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183660416 00000100:00100000:2.0:1788638580.960285:0:11999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1788638580.960292:0:11999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183660544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638580.960311:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788638580.960316:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad6c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183660288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638580.960339:0:11999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183660544:12345-0@lo:400:kworker.0 Request processed in 48us (134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638580.960344:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad6c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183660288:12345-0@lo:400:kworker.0 Request processed in 28us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638580.960346:0:11999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788638580.960348:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788638580.960361:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788638580.960366:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b489ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183660416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638580.960405:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183660544:0@lo:400:kworker.0 00000100:00100000:0.0:1788638580.960434:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183660160 00000100:00100000:0.0:1788638580.960438:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183660160 00000100:00080000:2.0:1788638580.960442:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788638580.960447:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788638580.960464:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1788638580.960471:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183660160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638580.960652:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183660672:0@lo:400:kworker.0 00000100:00100000:3.0:1788638580.967907:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788638580.967949:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183660800:0@lo:400:kworker.0 00000100:00100000:3.0:1788638580.970501:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638580.971590:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183660800 00000100:00100000:3.0:1788638580.971602:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183660800 00000100:00100000:3.0:1788638580.971680:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788638580.971690:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183660800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638580.971754:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4664000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183660800:12345-0@lo:400:kworker.0 Request processed in 65us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638580.971761:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788638580.971843:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183660416:0@lo:400:kworker.0 00000100:00100000:3.0:1788638580.971857:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183660288:0@lo:400:kworker.0 00000100:00100000:3.0:1788638580.971888:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183660800:0@lo:400:kworker.0 00000100:00080000:3.0:1788638580.971917:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788638580.974247:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b489ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183660416:12345-0@lo:400:kworker.0 Request processed in 13871us (14015us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638580.974263:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1788638580.975144:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383680850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183660160:12345-0@lo:400:kworker.0 Request processed in 14668us (15017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638580.975155:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1788638580.980271:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638580.980339:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387d9ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183660160:0@lo:400:kworker.0 00000100:00100000:2.0:1788638580.980422:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183660672 00000100:00100000:2.0:1788638580.980429:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183660672 00000100:00100000:2.0:1788638580.980485:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788638580.980494:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183660672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638580.980572:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875523183660672:12345-0@lo:400:kworker.0 Request processed in 78us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638580.980580:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:3.0:1788638580.980985:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788638580.985011:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183660672:0@lo:400:kworker.0 00000100:00100000:3.0:1788638581.390172:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638581.390549:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174241024 00000100:00100000:0.0:1788638581.390559:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174241024 00000100:00100000:0.0:1788638581.390628:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 66 00000100:00100000:0.0:1788638581.390639:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+18:12334:x1875523174241024:12345-192.168.203.34@tcp:35:umount.0 00000100:00080000:3.0:1788638581.390875:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638581.391051:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+19:12334:x1875523174241024:12345-192.168.203.34@tcp:35:umount.0 Request processed in 414us (888us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788638581.391059:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 66 00000100:00100000:3.0:1788638581.401363:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638581.401474:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174241280 00000100:00100000:0.0:1788638581.401494:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174241280 00000100:00100000:0.0:1788638581.401561:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 67 00000100:00100000:0.0:1788638581.401572:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+19:12334:x1875523174241280:12345-192.168.203.34@tcp:35:umount.0 00000100:00100000:0.0:1788638581.401947:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+20:12334:x1875523174241280:12345-192.168.203.34@tcp:35:umount.0 Request processed in 375us (609us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788638581.401955:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 67 00000100:00100000:3.0:1788638581.406639:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638581.407113:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174241536 00000100:00100000:0.0:1788638581.407123:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174241536 00000100:00100000:0.0:1788638581.407180:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 68 00000100:00100000:0.0:1788638581.407189:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73a5716450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+20:12334:x1875523174241536:12345-192.168.203.34@tcp:35:umount.0 00000100:00100000:0.0:1788638581.407419:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73a5716450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+21:12334:x1875523174241536:12345-192.168.203.34@tcp:35:umount.0 Request processed in 230us (789us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788638581.407427:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 68 00000100:00100000:3.0:1788638581.415028:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638581.415105:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174241792 00000100:00100000:0.0:1788638581.415116:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174241792 00000100:00100000:0.0:1788638581.415171:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 69 00000100:00100000:0.0:1788638581.415182:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+21:12334:x1875523174241792:12345-192.168.203.34@tcp:35:umount.0 00000100:00100000:0.0:1788638581.415535:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+22:12334:x1875523174241792:12345-192.168.203.34@tcp:35:umount.0 Request processed in 354us (514us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788638581.415545:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 69 00000100:00100000:3.0:1788638581.422289:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638581.422325:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638581.422773:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174241920 00000100:00100000:2.0:1788638581.422833:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174241920 00000100:00100000:2.0:1788638581.422890:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174242048 00000100:00100000:2.0:1788638581.422894:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174242048 00000100:00100000:2.0:1788638581.422932:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 18 00000100:00100000:2.0:1788638581.422941:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4666300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55273f9a-386c-4321-9748-c194b047efe8+14:2366:x1875523174241920:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638581.422956:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638581.422976:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7381684200/0xa0b1f1e3b4b2a7fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d27 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638581.422993:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638581.423044:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4666300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55273f9a-386c-4321-9748-c194b047efe8+13:2366:x1875523174241920:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 104us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638581.423052:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 18 00000100:00100000:2.0:1788638581.423080:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 19 00000100:00100000:2.0:1788638581.423087:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4664380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55273f9a-386c-4321-9748-c194b047efe8+12:2366:x1875523174242048:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638581.423095:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638581.423103:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73829f0200/0xa0b1f1e3b4b2a7c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434cef expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638581.423132:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638581.423152:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4664380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:55273f9a-386c-4321-9748-c194b047efe8+11:2366:x1875523174242048:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 65us (826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638581.423158:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 19 00000100:00100000:3.0:1788638581.428083:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638581.428271:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174242176 00000100:00100000:1.0:1788638581.428282:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174242176 00000100:00100000:1.0:1788638581.428350:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 20 00000100:00100000:1.0:1788638581.428360:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4667800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55273f9a-386c-4321-9748-c194b047efe8+11:2367:x1875523174242176:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638581.428388:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638581.428410:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7380031200/0xa0b1f1e3b4b2aa74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434df2 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638581.428429:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638581.428484:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4667800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55273f9a-386c-4321-9748-c194b047efe8+10:2367:x1875523174242176:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 125us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638581.428491:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 20 00000100:00100000:3.0:1788638581.428616:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638581.429147:0:11999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174242560 00000100:00100000:1.0:1788638581.429154:0:11999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174242560 00000100:00100000:1.0:1788638581.429209:0:11999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 74 00000100:00100000:1.0:1788638581.429234:0:11999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+7:2363:x1875523174242560:12345-192.168.203.34@tcp:9:umount.0 00000020:00000080:1.0:1788638581.429264:0:11999:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2ada0 00000020:00010000:1.0:1788638581.429271:0:11999:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c73ad6ef800: total 0 00000100:00080000:1.0:1788638581.429276:0:11999:0:(import.c:65:import_set_state_nolock()) ffff9c73ad6e9000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788638581.429316:0:11999:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788638581.429607:0:11999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2363:x1875523174242560:12345-192.168.203.34@tcp:9:umount.0 Request processed in 373us (990us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638581.429615:0:11999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 74 00000100:00080000:3.0:1788638581.430032:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:0.0:1788638581.430072:0:5831:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c73ad6ef800: total 0 00010000:00010000:0.0:1788638581.430104:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c73ad6ef800, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788638581.430157:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2b13c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fc7 expref: 4 pid: 6684 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638581.430189:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005f672074/0xa0b1f1e3b4b2b7da lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435195 expref: 3 pid: 6686 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638581.430215:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c73ad6ef800, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1788638581.430227:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638581.430229:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638581.430231:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638581.444291:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638581.444443:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174242688 00000100:00100000:0.0:1788638581.444457:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174242688 00000100:00100000:0.0:1788638581.444553:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 75 00000100:00100000:0.0:1788638581.444565:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+5:2363:x1875523174242688:12345-192.168.203.34@tcp:9:umount.0 00000020:00000080:0.0:1788638581.444595:0:6684:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2ab38 00000100:00080000:0.0:1788638581.444605:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9c73bc010800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788638581.444652:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788638581.444968:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4664700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+2:2363:x1875523174242688:12345-192.168.203.34@tcp:9:umount.0 Request processed in 404us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638581.444978:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 75 00010000:00010000:2.0:1788638581.445203:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788638581.445826:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788638581.456925:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638581.457122:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174243712 00000100:00100000:2.0:1788638581.457133:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174243712 00000100:00100000:2.0:1788638581.457198:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 240 00000100:00100000:2.0:1788638581.457209:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+22:2363:x1875523174243712:12345-192.168.203.34@tcp:39:umount.0 00000020:00000080:2.0:1788638581.457242:0:5842:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a7d4 00000020:00010000:2.0:1788638581.457260:0:5842:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c73ad477000: total 0 00000100:00080000:2.0:1788638581.457264:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9c73ad476800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788638581.457295:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1788638581.457672:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:00196f64-ae55-4ffc-b84c-468028ab3a77+21:2363:x1875523174243712:12345-192.168.203.34@tcp:39:umount.0 Request processed in 457us (748us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788638581.457681:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 240 00000020:00010000:0.0:1788638581.459049:0:5830:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c73ad477000: total 0 00010000:00010000:0.0:1788638581.459111:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c73ad477000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788638581.459146:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:0.0:1788638581.459150:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788638581.459161:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2b01d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434f7a expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638581.459187:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:0.0:1788638581.459190:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788638581.459195:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c000/0xa0b1f1e3b4b2ab0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e1c expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638581.459232:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:0.0:1788638581.459234:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788638581.459239:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd800/0xa0b1f1e3b4b2b6bb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435148 expref: 18 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638581.459253:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:0.0:1788638581.459256:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788638581.459260:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030c00/0xa0b1f1e3b4b2b1ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fea expref: 17 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638581.459274:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7398420a00) 00010000:00010000:0.0:1788638581.459276:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788638581.459280:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309400/0xa0b1f1e3b4b2b19e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fe3 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638581.459291:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c73a1cf7600) 00010000:00010000:0.0:1788638581.459293:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638581.459297:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c400/0xa0b1f1e3b4b2aaba lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e07 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638581.459315:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:0.0:1788638581.459318:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788638581.459322:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309c00/0xa0b1f1e3b4b2b0fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fb2 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638581.459333:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:0.0:1788638581.459336:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788638581.459347:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6400/0xa0b1f1e3b4b2b79b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435180 expref: 13 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638581.459363:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9c7393e81f00) 00010000:00010000:0.0:1788638581.459365:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788638581.459369:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fce00/0xa0b1f1e3b4b2b499 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14350bc expref: 12 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638581.459388:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9c7393e81e00) 00010000:00010000:0.0:1788638581.459392:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788638581.459396:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385309000/0xa0b1f1e3b4b2b7c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143518e expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638581.459410:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9c73a1cf7700) 00010000:00010000:0.0:1788638581.459412:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788638581.459416:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031c00/0xa0b1f1e3b4b2adfb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434eee expref: 10 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638581.459431:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c7398420300) 00010000:00010000:0.0:1788638581.459433:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788638581.459437:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7385308800/0xa0b1f1e3b4b2aa9e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434e00 expref: 9 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638581.459453:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9c738a6e9f00) 00010000:00010000:0.0:1788638581.459456:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788638581.459459:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030400/0xa0b1f1e3b4b2b127 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434fc0 expref: 8 pid: 7634 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638581.459473:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c73ad477000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788638581.459493:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638581.459495:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638581.459497:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638581.477268:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638581.477289:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183660928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788638581.477357:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638581.477432:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183660928 00000100:00100000:0.0:1788638581.477440:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183660928 00000100:00100000:0.0:1788638581.477489:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788638581.477498:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183660928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788638581.477531:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638581.477576:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183660928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638581.477584:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788638581.477631:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183660928:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788638581.575028:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 00196f64-ae55-4ffc-b84c-468028ab3a77 00000020:00000080:1.0:1788638581.575037:0:6711:0:(genops.c:885:class_export_put()) final put ffff9c73bc015000/00196f64-ae55-4ffc-b84c-468028ab3a77 00000020:00000080:3.0:1788638581.575354:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73bc015000/00196f64-ae55-4ffc-b84c-468028ab3a77 for lustre-OST0000 00000020:00000080:3.0:1788638581.575409:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73bc010800 for lustre-OST0000 00010000:00010000:0.0:1788638581.664219:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788638582.544898:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 00196f64-ae55-4ffc-b84c-468028ab3a77 00000020:00000080:3.0:1788638582.545376:0:7651:0:(genops.c:885:class_export_put()) final put ffff9c73ad6ef800/00196f64-ae55-4ffc-b84c-468028ab3a77 00000020:00000080:0.0:1788638582.545640:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73ad6ef800/00196f64-ae55-4ffc-b84c-468028ab3a77 for lustre-OST0001 00000020:00000080:0.0:1788638582.545697:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73ad6e9000 for lustre-OST0001 00000001:00080000:1.0:1788638582.597733:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:1.0:1788638582.598195:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 00196f64-ae55-4ffc-b84c-468028ab3a77 00000001:00080000:1.0:1788638582.598205:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1788638582.598208:0:5864:0:(genops.c:885:class_export_put()) final put ffff9c73ad477000/00196f64-ae55-4ffc-b84c-468028ab3a77 00000020:00000080:3.0:1788638582.598259:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73ad477000/00196f64-ae55-4ffc-b84c-468028ab3a77 for lustre-MDT0000 00000020:00000080:3.0:1788638582.598316:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73ad476800 for lustre-MDT0000 00010000:00010000:2.0:1788638582.689455:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638583.274194:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638583.274315:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638583.280102:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638583.282661:0:11689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174243968 00000100:00100000:2.0:1788638583.282675:0:11689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174243968 00000100:00100000:2.0:1788638583.287109:0:11689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174243840 00000100:00100000:2.0:1788638583.287125:0:11689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174243840 00000100:00100000:1.0:1788638583.289268:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 21 00000100:00100000:1.0:1788638583.289292:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4665c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55273f9a-386c-4321-9748-c194b047efe8+11:2365:x1875523174243968:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638583.289312:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638583.289332:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73813fc200/0xa0b1f1e3b4b2a8ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d66 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638583.289351:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638583.289412:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4665c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55273f9a-386c-4321-9748-c194b047efe8+10:2365:x1875523174243968:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 132us (15228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638583.289421:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 21 00000100:00100000:0.0:1788638583.289443:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 22 00000100:00100000:0.0:1788638583.289455:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55273f9a-386c-4321-9748-c194b047efe8+9:2365:x1875523174243840:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788638583.289465:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638583.289475:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7399aa6200/0xa0b1f1e3b4b2a8a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d3c expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638583.289486:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638583.289504:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384df9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:55273f9a-386c-4321-9748-c194b047efe8+8:2365:x1875523174243840:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 53us (15190us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638583.289528:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 22 00000100:00100000:1.0:1788638583.293588:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174244096 00000100:00100000:1.0:1788638583.293613:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174244096 00000100:00100000:3.0:1788638583.293734:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638583.293758:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174244352 00000100:00100000:3.0:1788638583.293762:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174244352 00000100:00100000:3.0:1788638583.293828:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 241 00000100:00100000:3.0:1788638583.293838:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdbf9a9f-afb3-447e-b3b7-3039526706d5+6:2363:x1875523174244352:12345-192.168.203.34@tcp:39:umount.0 00000100:00100000:1.0:1788638583.294339:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 23 00000100:00100000:1.0:1788638583.294347:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4665f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55273f9a-386c-4321-9748-c194b047efe8+8:2366:x1875523174244096:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638583.294360:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638583.294380:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73bc01de00/0xa0b1f1e3b4b2aa6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434deb expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638583.294397:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1788638583.294404:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788638583.294445:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4665f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:55273f9a-386c-4321-9748-c194b047efe8+7:2366:x1875523174244096:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 99us (14351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638583.294453:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 23 00000020:00000080:3.0:1788638583.298583:0:7634:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a8bb 00000020:00010000:3.0:1788638583.298596:0:7634:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c73bf2d4800: total 0 00000100:00080000:3.0:1788638583.298602:0:7634:0:(import.c:65:import_set_state_nolock()) ffff9c73bf2d0800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788638583.298639:0:7634:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:0.0:1788638583.298846:0:5830:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c73bf2d4800: total 0 00010000:00010000:0.0:1788638583.298852:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638583.298901:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c73bf2d4800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788638583.299041:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c7398420a00) 00010000:00010000:0.0:1788638583.299046:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788638583.299065:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b7e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143519c expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638583.299091:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c73bf2d4800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788638583.299106:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638583.299110:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638583.299112:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638583.299200:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:cdbf9a9f-afb3-447e-b3b7-3039526706d5+3:2363:x1875523174244352:12345-192.168.203.34@tcp:39:umount.0 Request processed in 5361us (5468us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788638583.299392:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 241 00000100:00100000:3.0:1788638583.335596:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638583.335989:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174244608 00000100:00100000:1.0:1788638583.335999:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174244608 00000100:00100000:1.0:1788638583.336117:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 306 00000100:00100000:1.0:1788638583.336129:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+7:2363:x1875523174244608:12345-192.168.203.34@tcp:251:umount.0 00000020:00000080:1.0:1788638583.336174:0:5834:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a7b1 00000020:00010000:1.0:1788638583.336182:0:5834:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c72833b8000: total 0 00000100:00080000:1.0:1788638583.336187:0:5834:0:(import.c:65:import_set_state_nolock()) ffff9c72833ba800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788638583.336265:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383682850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:55273f9a-386c-4321-9748-c194b047efe8+3:2363:x1875523174244608:12345-192.168.203.34@tcp:251:umount.0 Request processed in 138us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638583.336273:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 306 00000020:00010000:0.0:1788638583.338244:0:5831:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c72833b8000: total 0 00010000:00010000:0.0:1788638583.338299:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c72833b8000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788638583.338335:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7381684a00/0xa0b1f1e3b4b2a805 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1434d2e expref: 2 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638583.338366:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c72833b8000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788638583.338376:0:5831:0:(genops.c:885:class_export_put()) final put ffff9c72833b8000/55273f9a-386c-4321-9748-c194b047efe8 00010000:00010000:0.0:1788638583.338398:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638583.338400:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638583.338402:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788638583.339048:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c72833b8000/55273f9a-386c-4321-9748-c194b047efe8 for MGS 00000020:00000080:3.0:1788638583.339099:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c72833ba800 for MGS 00010000:00010000:2.0:1788638583.712975:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638584.053248:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183661056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788638584.053351:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638584.055253:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183661056 00000100:00100000:1.0:1788638584.055282:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183661056 00000100:00100000:1.0:1788638584.055368:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788638584.055381:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183661056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788638584.055450:0:6688:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788638584.055548:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183661056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 170us (2196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638584.055556:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788638584.055636:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183661056:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788638584.056393:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:3.0:1788638584.608269:0:11706:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788638584.608282:0:11706:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788638584.608883:0:11706:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1788638584.608892:0:11706:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788638584.735891:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788638585.472362:0:12995:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788638585.490203:0:12995:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788638585.490249:0:12995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2a844 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a84b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638585.490276:0:12995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2a844 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a84b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638585.490284:0:12995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2a844 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2a84b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638585.490292:0:12995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2a844 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2a84b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638585.490439:0:12995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788638585.490446:0:12995:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788638585.490470:0:12995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788638585.490474:0:12995:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788638585.490480:0:12995:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788638585.490503:0:12995:0:(import.c:65:import_set_state_nolock()) ffff9c7398781000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788638585.491136:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638585.491144:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2a844 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2a84b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638585.491152:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7e00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:1.0:1788638585.491156:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2a844 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2a84b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638585.491165:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2a844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2a84b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638585.491172:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2a844 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2a84b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638585.491177:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788638585.491180:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788638585.491182:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788638585.491207:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2a844 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2a84b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638585.491214:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788638585.491231:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2a844 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2a84b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638585.491238:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2a844 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2a84b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638585.491258:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638585.491260:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638585.491262:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638585.491334:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7391b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183661312:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788638585.491394:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638585.491458:0:11689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183661312 00000100:00100000:1.0:1788638585.491464:0:11689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183661312 00000100:00100000:3.0:1788638585.491475:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875523183661184:0@lo:39:umount.0 00000100:00100000:3.0:1788638585.491516:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638585.491516:0:11689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788638585.491528:0:11689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3294:x1875523183661312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788638585.491541:0:11689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788638585.491557:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183661184 00000100:00100000:3.0:1788638585.491562:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183661184 00000100:00100000:3.0:1788638585.491590:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788638585.491596:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875523183661184:12345-0@lo:39:umount.0 00010000:00010000:1.0:1788638585.491621:0:11689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7385309a00/0xa0b1f1e3b4b2a84b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a844 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1788638585.491627:0:5842:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a5c0 00010000:00010000:1.0:1788638585.491635:0:11689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:3.0:1788638585.491637:0:5842:0:(import.c:65:import_set_state_nolock()) ffff9c73bbb57800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788638585.491688:0:11689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b48700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:3294:x1875523183661312:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638585.491697:0:11689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788638585.491702:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3290:x1875523183661184:12345-0@lo:39:umount.0 Request processed in 103us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638585.491710:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:3.0:1788638585.491719:0:5842:0:(genops.c:885:class_export_put()) final put ffff9c73bbb52000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1788638585.491744:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638585.491751:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7391b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183661312:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1788638585.491754:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73bbb52000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1788638585.491812:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73bbb57800 for lustre-MDT0000 00000100:00080000:3.0:1788638585.491839:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c7398781000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788638585.491848:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875523183661184:0@lo:39:umount.0 00000100:00080000:2.0:1788638585.492456:0:12995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788638585.492460:0:12995:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788638585.492465:0:12995:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788638585.493460:0:12995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fcc00/0xa0b1f1e3b4b2a852 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a859 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638585.493474:0:12995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fcc00/0xa0b1f1e3b4b2a852 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a859 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638585.493484:0:12995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fcc00/0xa0b1f1e3b4b2a852 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2a859 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638585.493492:0:12995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: ffff9c73813fcc00/0xa0b1f1e3b4b2a852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2a859 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638585.493573:0:12995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788638585.493581:0:12995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7200/0xa0b1f1e3b4b2a76b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a772 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638585.493588:0:12995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7200/0xa0b1f1e3b4b2a76b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a772 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638585.493595:0:12995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7200/0xa0b1f1e3b4b2a76b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2a772 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638585.493602:0:12995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7200/0xa0b1f1e3b4b2a76b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2a772 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638585.493633:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788638585.493641:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c73813fcc00/0xa0b1f1e3b4b2a852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2a859 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638585.493649:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fcc00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:3.0:1788638585.493653:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c73813fcc00/0xa0b1f1e3b4b2a852 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2a859 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638585.493662:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c73813fcc00/0xa0b1f1e3b4b2a852 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2a859 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788638585.493669:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c73813fcc00/0xa0b1f1e3b4b2a852 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2a859 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638585.493676:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788638585.493678:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1788638585.493705:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c73813fcc00/0xa0b1f1e3b4b2a852 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2a859 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638585.493718:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788638585.493741:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c73813fcc00/0xa0b1f1e3b4b2a852 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2a859 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638585.493749:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c73813fcc00/0xa0b1f1e3b4b2a852 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2a859 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638585.493764:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638585.493768:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7200/0xa0b1f1e3b4b2a76b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2a772 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638585.493775:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7200 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:3.0:1788638585.493779:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7200/0xa0b1f1e3b4b2a76b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2a772 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638585.493804:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7200/0xa0b1f1e3b4b2a76b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2a772 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788638585.493812:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7200/0xa0b1f1e3b4b2a76b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2a772 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638585.493818:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1788638585.493820:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:3.0:1788638585.493836:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7200/0xa0b1f1e3b4b2a76b lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2a772 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638585.493843:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788638585.493850:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7200/0xa0b1f1e3b4b2a76b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2a772 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638585.493869:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638585.493871:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638585.493874:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638585.493890:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183661440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788638585.494014:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638585.494080:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788638585.494088:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183661568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788638585.494115:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638585.494149:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183661440 00000100:00100000:3.0:1788638585.494154:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183661440 00000100:00100000:3.0:1788638585.494189:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183661568 00000100:00100000:3.0:1788638585.494191:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183661568 00000100:00100000:3.0:1788638585.494212:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788638585.494221:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4667100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+19:3291:x1875523183661440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788638585.494231:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638585.494243:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73829f1800/0xa0b1f1e3b4b2a859 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a852 expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638585.494255:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638585.494285:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4667100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+18:3291:x1875523183661440:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638585.494292:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788638585.494307:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788638585.494312:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4666300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+17:3291:x1875523183661568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788638585.494319:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638585.494327:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73829f0600/0xa0b1f1e3b4b2a772 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a76b expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638585.494344:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638585.494367:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4666300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:3291:x1875523183661568:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638585.494374:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788638585.494404:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183661568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788638585.494412:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183661440:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788638585.494552:0:12995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788638585.494558:0:12995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7200/0xa0b1f1e3b4b2a76b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2a772 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638585.494575:0:12995:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788638585.494584:0:12995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2aa5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2aa66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638585.494592:0:12995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2aa5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2aa66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638585.494599:0:12995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2aa5f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2aa66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638585.494607:0:12995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2aa5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2aa66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638585.494647:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638585.494653:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2aa5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2aa66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638585.494660:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c800 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:1.0:1788638585.494663:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2aa5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2aa66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638585.494681:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2aa5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2aa66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638585.494688:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2aa5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2aa66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638585.494693:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788638585.494696:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788638585.494709:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2aa5f lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2aa66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638585.494714:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788638585.494737:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2aa5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2aa66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638585.494746:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638585.494748:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638585.494750:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638585.494756:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788638585.494765:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7391b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183661696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788638585.494847:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638585.494889:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183661696 00000100:00100000:1.0:1788638585.494893:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183661696 00000100:00100000:1.0:1788638585.494993:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788638585.495000:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+16:3294:x1875523183661696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788638585.495008:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638585.495016:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73bc01d400/0xa0b1f1e3b4b2aa66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2aa5f expref: 16 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638585.495035:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638585.495075:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:3294:x1875523183661696:12345-0@lo:103:ldlm_bl.0 Request processed in 76us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638585.495082:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788638585.495107:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7391b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183661696:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788638585.495230:0:12995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788638585.495235:0:12995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2aa5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2aa66 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638585.495244:0:12995:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788638585.495251:0:12995:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2a51f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a526 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638585.495257:0:12995:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2a51f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a526 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638585.495264:0:12995:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2a51f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2a526 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638585.495270:0:12995:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2a51f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2a526 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638585.495294:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638585.495299:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2a51f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2a526 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638585.495307:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030a00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:3.0:1788638585.495310:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2a51f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2a526 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638585.495317:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2a51f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2a526 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788638585.495324:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2a51f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2a526 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638585.495330:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1788638585.495333:0:7639:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:3.0:1788638585.495348:0:7639:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2a51f lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2a526 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638585.495354:0:7639:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788638585.495375:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2a51f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2a526 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638585.495395:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638585.495397:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638585.495400:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638585.495406:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788638585.495416:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183661824:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788638585.495453:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638585.495491:0:11689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183661824 00000100:00100000:3.0:1788638585.495495:0:11689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183661824 00000100:00100000:3.0:1788638585.495526:0:11689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788638585.495534:0:11689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4665500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+15:3293:x1875523183661824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788638585.495544:0:11689:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638585.495553:0:11689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7380031000/0xa0b1f1e3b4b2a526 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a51f expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638585.495567:0:11689:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638585.495598:0:11689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4665500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:3293:x1875523183661824:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638585.495605:0:11689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788638585.495639:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183661824:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788638585.495715:0:12995:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788638585.495720:0:12995:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2a51f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2a526 expref: -99 pid: 5823 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638585.495731:0:12995:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:2.0:1788638585.495734:0:12995:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1788638585.495737:0:12995:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:2.0:1788638585.495763:0:12995:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:2.0:1788638585.495767:0:12995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:2.0:1788638585.495771:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788638585.495777:0:12995:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00010000:00010000:3.0:1788638585.495845:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788638585.495879:0:12995:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c73ad470000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788638585.495890:0:12995:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9c73bf0ee800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788638585.495897:0:12995:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9c73bf2d4800 cdbf9a9f-afb3-447e-b3b7-3039526706d5 192.168.203.34@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788638585.495902:0:12995:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9c73837599c0) has exports, disconnecting them 00000020:00080000:2.0:1788638585.495906:0:12995:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c73ad470000), last request at 1788638580 00000020:00000080:2.0:1788638585.495976:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a733 00000100:00080000:2.0:1788638585.495991:0:12995:0:(import.c:65:import_set_state_nolock()) ffff9c73ad472800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788638585.496076:0:12995:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c73ad470000): rc 0 00000020:00000080:2.0:1788638585.496079:0:12995:0:(genops.c:885:class_export_put()) final put ffff9c73ad470000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:2.0:1788638585.496094:0:12995:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9c73bf0ee800), last request at 1788638580 00000020:00000080:2.0:1788638585.496097:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a65a 00000100:00080000:2.0:1788638585.496103:0:12995:0:(import.c:65:import_set_state_nolock()) ffff9c73bf0e9000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788638585.496138:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73ad470000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1788638585.496176:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73ad472800 for lustre-MDT0000 00010000:00010000:1.0:1788638585.496722:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788638585.496818:0:12995:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c73bf0ee800): rc 0 00000020:00000080:2.0:1788638585.496821:0:12995:0:(genops.c:885:class_export_put()) final put ffff9c73bf0ee800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1788638585.496836:0:12995:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbd4883143ae0 00000100:00080000:2.0:1788638585.496855:0:12995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788638585.496858:0:12995:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1788638585.496873:0:12995:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788638585.496944:0:12995:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788638585.496959:0:12995:0:(import.c:65:import_set_state_nolock()) ffff9c73bc023800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788638585.496975:0:12995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788638585.496977:0:12995:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:2.0:1788638585.496991:0:12995:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788638585.497064:0:12995:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788638585.497075:0:12995:0:(import.c:65:import_set_state_nolock()) ffff9c73bf0e8000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788638585.497101:0:12995:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9c73837599c0) has no exports 00000020:00000080:1.0:1788638585.497336:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73bf0ee800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788638585.497374:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73bf0e9000 for lustre-MDT0000 00010000:00010000:3.0:1788638585.497799:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638585.497813:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183661952:0@lo:9:umount.0 00000100:00100000:3.0:1788638585.497920:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638585.497948:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183662080:0@lo:9:umount.0 00000100:00100000:3.0:1788638585.497980:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638585.501827:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183661952 00000100:00100000:3.0:1788638585.501843:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183661952 00000100:00100000:3.0:1788638585.501907:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183662080 00000100:00100000:2.0:1788638585.502087:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788638585.502098:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3290:x1875523183661952:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788638585.502228:0:6684:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a6a7 00000100:00080000:2.0:1788638585.502239:0:6684:0:(import.c:65:import_set_state_nolock()) ffff9c73aeff9800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788638585.502277:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788638585.502631:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3290:x1875523183661952:12345-0@lo:9:umount.0 Request processed in 534us (4762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638585.502639:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:2.0:1788638585.503011:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638585.503085:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183662080 00000100:00100000:3.0:1788638585.503124:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788638585.503132:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3290:x1875523183662080:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788638585.503147:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a79c 00000100:00080000:3.0:1788638585.503212:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9c72833bd000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788638585.503241:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788638585.503533:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4664380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3290:x1875523183662080:12345-0@lo:9:umount.0 Request processed in 400us (5550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638585.503541:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1788638585.503560:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788638585.503567:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788638585.503595:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73bc023800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788638585.503608:0:3290:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788638585.503610:0:3290:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788638585.503615:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183661952:0@lo:9:umount.0 00000100:00080000:3.0:1788638585.503630:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73bf0e8000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1788638585.503639:0:3290:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1788638585.503640:0:3290:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788638585.503643:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183662080:0@lo:9:umount.0 00000020:00080000:2.0:1788638585.512093:0:12995:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9c73837599c0) has no exports 00000020:00000080:2.0:1788638585.576430:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a57a 00000020:00000080:2.0:1788638585.576445:0:12995:0:(genops.c:885:class_export_put()) final put ffff9c73b4e18000/lustre-QMT0000_UUID 00000020:01000000:2.0:1788638585.576467:0:12995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1788638585.576542:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788638585.576553:0:12995:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788638585.576558:0:12995:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9c73bce3b380) has no exports 00000020:00000080:1.0:1788638585.576753:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73b4e18000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788638585.576852:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a573 00000020:00000080:3.0:1788638585.576857:0:12995:0:(genops.c:885:class_export_put()) final put ffff9c73bce5e800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788638585.576913:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788638585.576933:0:12995:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788638585.576936:0:12995:0:(genops.c:885:class_export_put()) final put ffff9c73b4525800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788638585.576939:0:12995:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73b4525800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788638585.576945:0:12995:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788638585.577127:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73bce5e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788638585.760223:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638586.082496:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788638586.082525:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7391b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183662208:0@lo:400:kworker.0 00000100:00100000:1.0:1788638586.082525:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183662464:0@lo:400:kworker.0 00000100:00100000:2.0:1788638586.086350:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183662336:0@lo:400:kworker.0 00000100:00100000:1.0:1788638586.093633:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638586.093859:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183662464 00000100:00100000:0.0:1788638586.093869:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183662464 00000100:00100000:0.0:1788638586.093929:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788638586.093938:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3294:x1875523183662464:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788638586.093963:0:5843:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788638586.094028:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3294:x1875523183662464:12345-0@lo:400:kworker.0 Request processed in 90us (402us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788638586.094044:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:1.0:1788638586.095533:0:3294:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788638586.095540:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9c73ad654000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788638586.095543:0:3294:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1788638586.100865:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638586.101167:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183662208 00000100:00100000:0.0:1788638586.101177:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183662208 00000100:00100000:0.0:1788638586.101236:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788638586.101246:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7383681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:3291:x1875523183662208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638586.101331:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7383681c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:3291:x1875523183662208:12345-0@lo:400:kworker.0 Request processed in 86us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638586.101338:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788638586.108125:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7391b49880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183662208:0@lo:400:kworker.0 00000100:00100000:2.0:1788638586.113625:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638586.127853:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183662336 00000100:00100000:3.0:1788638586.127866:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183662336 00000100:00100000:0.0:1788638586.128123:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788638586.128131:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3292:x1875523183662336:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1788638586.128140:0:5842:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788638586.128215:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3292:x1875523183662336:12345-0@lo:400:kworker.0 Request processed in 84us (14598us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788638586.128223:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1788638586.128820:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9c73ad654000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788638586.128827:0:3294:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 158 00000100:00080000:1.0:1788638586.128833:0:3294:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c73ad654000 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:1.0:1788638586.128863:0:3294:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73b7d07800 x1875523183662592/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788638586.128895:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3294:1875523183662464:0@lo:400:kworker.0 00000100:00100000:0.0:1788638586.129098:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1875523183662592:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1788638586.129139:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638586.129258:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183662592 00000100:00100000:3.0:1788638586.129263:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183662592 00000100:00100000:3.0:1788638586.129299:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788638586.129305:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3290:x1875523183662592:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:3.0:1788638586.129319:0:5844:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1788638586.130377:0:3292:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788638586.130382:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9c73b7e9b800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788638586.130385:0:3292:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788638586.130389:0:3292:0:(import.c:65:import_set_state_nolock()) ffff9c73b7e9b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788638586.130393:0:3292:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 140 00000100:00080000:2.0:1788638586.130398:0:3292:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c73b7e9b800 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:2.0:1788638586.130417:0:3292:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c738537b100 x1875523183662720/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788638586.130442:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183662336:0@lo:400:kworker.0 00000100:00100000:0.0:1788638586.130497:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1875523183662720:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788638586.130544:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638586.130642:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183662720 00000100:00100000:2.0:1788638586.130648:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183662720 00000100:00100000:2.0:1788638586.130677:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1788638586.130682:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1875523183662720:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:2.0:1788638586.130704:0:5842:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:2.0:1788638586.130737:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1875523183662720:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 54us (193us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788638586.130744:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:0.0:1788638586.130855:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73b7e9b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788638586.130860:0:3290:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788638586.130863:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1875523183662720:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788638586.172014:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3290:x1875523183662592:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 42698us (42865us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788638586.172057:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1788638586.172172:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73ad654000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788638586.172183:0:3290:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788638586.172187:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1875523183662592:0@lo:38:ptlrpcd_00_03.0 00000001:00100000:1.0:1788638586.646546:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788638586.646554:0:6711:0:(genops.c:885:class_export_put()) final put ffff9c73aeffd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788638586.646667:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73aeffd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788638586.646717:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73aeff9800 for lustre-OST0000 00010000:00010000:2.0:1788638586.784169:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788638587.677150:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788638587.677159:0:7651:0:(genops.c:885:class_export_put()) final put ffff9c72833bd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788638587.677192:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c72833bd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788638587.677237:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c72833bd000 for lustre-OST0001 00000001:00100000:1.0:1788638587.721005:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of cdbf9a9f-afb3-447e-b3b7-3039526706d5 00000001:00080000:1.0:1788638587.721018:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1788638587.721029:0:5864:0:(genops.c:885:class_export_put()) final put ffff9c73bf2d4800/cdbf9a9f-afb3-447e-b3b7-3039526706d5 00000020:00000080:1.0:1788638587.721051:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73bf2d4800/cdbf9a9f-afb3-447e-b3b7-3039526706d5 for lustre-MDT0000 00000020:00000080:1.0:1788638587.721100:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73bf2d0800 for lustre-MDT0000 00010000:00010000:3.0:1788638587.808386:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638588.839490:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638589.856064:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638590.880185:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638591.200049:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183662848:0@lo:400:kworker.0 00000100:00100000:2.0:1788638591.200145:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788638591.200228:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788638591.200232:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788638591.200235:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c73b7e9b800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788638591.200240:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 349 00000100:00080000:1.0:1788638591.200245:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788638591.200252:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c73b7e9b800 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:1.0:1788638591.200275:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73b7d06300 x1875523183662976/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788638591.200296:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788638591.200299:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788638591.200301:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c73ad654000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788638591.200305:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 349 00000100:00080000:1.0:1788638591.200335:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788638591.200339:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c73ad654000 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:1.0:1788638591.200352:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73b7d06a00 x1875523183663104/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788638591.200380:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1875523183662976:0@lo:38:kworker.0 00000100:00100000:1.0:1788638591.200417:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638591.200440:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1875523183663104:0@lo:38:kworker.0 00000100:00100000:1.0:1788638591.200459:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638591.200513:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183662976 00000100:00100000:1.0:1788638591.200521:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183662976 00000100:00100000:1.0:1788638591.200549:0:7634:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183663104 00000100:00100000:1.0:1788638591.200551:0:7634:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183663104 00000100:00100000:1.0:1788638591.200565:0:7634:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788638591.200572:0:7634:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3290:x1875523183662976:12345-0@lo:38:kworker.0 00010000:02000000:1.0:1788638591.200587:0:7634:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788638591.200884:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788638591.200891:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3290:x1875523183663104:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788638591.200898:0:5843:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788638591.200945:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3290:x1875523183663104:12345-0@lo:38:kworker.0 Request processed in 52us (483us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788638591.200951:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:0.0:1788638591.201024:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73ad654000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788638591.201029:0:3290:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788638591.201032:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d06a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1875523183663104:0@lo:38:kworker.0 00000100:00100000:3.0:1788638591.201438:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183662848 00000100:00100000:3.0:1788638591.201444:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183662848 00000100:00100000:3.0:1788638591.201482:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1788638591.201490:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:3294:x1875523183662848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638591.206316:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:69cfc228-c5da-4a8f-95bc-89dfb88a5f68+14:3294:x1875523183662848:12345-0@lo:400:kworker.0 Request processed in 4816us (6160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638591.206338:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1788638591.209797:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3294:1875523183662848:0@lo:400:kworker.0 00000100:00100000:1.0:1788638591.212557:0:7634:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3290:x1875523183662976:12345-0@lo:38:kworker.0 Request processed in 11976us (12131us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788638591.212572:0:7634:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00080000:0.0:1788638591.214778:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73b7e9b800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788638591.214804:0:3290:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788638591.214808:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1875523183662976:0@lo:38:kworker.0 00000020:01000000:0.0:1788638591.648029:0:12995:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c739830d2a0 - data ffff9c73bf9d1288/ffff9c73bf13b000 00000020:01000000:0.0:1788638591.648161:0:12995:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c7398ba1d20 - data ffff9c73a7b48510/ffff9c73bcddf000 00000001:00000004:0.0:1788638591.667161:0:12995:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:3.0:1788638591.790102:0:12995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788638591.790122:0:12995:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1788638591.790196:0:12995:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788638591.790199:0:12995:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788638591.794441:0:6783:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788638591.794448:0:6783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:0.0:1788638591.794458:0:6783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788638591.795585:0:12995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788638591.795591:0:12995:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1788638591.795609:0:12995:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788638591.795611:0:12995:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788638591.797432:0:7956:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788638591.797438:0:7956:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1788638591.797448:0:7956:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00010000:00010000:0.0:1788638591.903932:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788638591.964930:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a542 00000020:00000080:1.0:1788638591.964941:0:12995:0:(genops.c:885:class_export_put()) final put ffff9c73ada80800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788638591.966190:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a557 00000020:00000080:1.0:1788638591.966198:0:12995:0:(genops.c:885:class_export_put()) final put ffff9c73b4e1d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788638591.966588:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73ada80800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788638591.966641:0:12995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788638591.966647:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788638591.966654:0:12995:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788638591.966658:0:12995:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9c738375cd40) has no exports 00000020:00000080:3.0:1788638591.966894:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73b4e1d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1788638591.966959:0:12995:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788638591.966967:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a795 00000020:00000080:1.0:1788638591.966971:0:12995:0:(genops.c:885:class_export_put()) final put ffff9c73ad657000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788638591.967023:0:12995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788638591.967027:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788638591.967033:0:12995:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788638591.967035:0:12995:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9c73bce3cd40) has no exports 00000020:00000080:1.0:1788638591.967041:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a78e 00000020:00000080:1.0:1788638591.967044:0:12995:0:(genops.c:885:class_export_put()) final put ffff9c73bf0eb000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788638591.967347:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73ad657000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1788638591.967708:0:12995:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788638591.967713:0:12995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788638591.967717:0:12995:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:1.0:1788638591.967723:0:12995:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788638591.967725:0:12995:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788638591.967754:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788638591.967761:0:12995:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788638591.967766:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a6a0 00000020:00000080:1.0:1788638591.967771:0:12995:0:(genops.c:885:class_export_put()) final put ffff9c73bf0ee000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788638591.967774:0:12995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788638591.967778:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788638591.970350:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73bf0eb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788638591.970365:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73bf0e8000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788638591.970377:0:37:0:(genops.c:885:class_export_put()) final put ffff9c73bf2d2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788638591.970381:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73bf2d2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788638591.970386:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788638591.970463:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73bf0ee000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1788638591.970927:0:12995:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788638591.970933:0:12995:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9c7385324d40) has no exports 00000020:00000080:1.0:1788638591.970941:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a699 00000020:00000080:1.0:1788638591.970947:0:12995:0:(genops.c:885:class_export_put()) final put ffff9c73bc026000/lustre-MDT0000-osd_UUID 00010000:01000000:1.0:1788638591.971419:0:12995:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788638591.971423:0:12995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788638591.971427:0:12995:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1788638591.971550:0:12995:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788638591.971554:0:12995:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788638591.971595:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73bc026000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788638591.971690:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788638591.971700:0:12995:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788638591.971732:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788638591.971736:0:12995:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788638591.971739:0:12995:0:(genops.c:885:class_export_put()) final put ffff9c73ada86000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788638591.971742:0:12995:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73ada86000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788638591.971761:0:12995:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788638591.972039:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a55e 00000020:00000080:1.0:1788638591.972045:0:12995:0:(genops.c:885:class_export_put()) final put ffff9c73b4e1d800/lustre-MDD0000_UUID 00000020:00000080:0.0:1788638591.972076:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73bc023800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788638591.972082:0:37:0:(genops.c:885:class_export_put()) final put ffff9c73b7e9c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788638591.972090:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73b7e9c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788638591.972094:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788638591.972202:0:12995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788638591.972206:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788638591.972211:0:12995:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788638591.972214:0:12995:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9c73ad9c3380) has no exports 00000020:00000080:0.0:1788638591.972318:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73b4e1d800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788638591.972360:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788638591.972364:0:12995:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788638591.972367:0:12995:0:(genops.c:885:class_export_put()) final put ffff9c73b4e1a000/lustre-MDD0000_UUID 00000020:00000080:1.0:1788638591.972370:0:12995:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73b4e1a000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788638591.972374:0:12995:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788638591.972538:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a565 00000020:00000080:1.0:1788638591.972543:0:12995:0:(genops.c:885:class_export_put()) final put ffff9c73b4e1c800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788638591.972585:0:12995:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7387a11800 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788638591.972588:0:12995:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7387a11800 3 00000020:01000004:1.0:1788638591.972592:0:12995:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c7387a11800 from lustre-MDT0000 00000020:00000080:1.0:1788638591.972610:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788638591.972613:0:12995:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788638591.972615:0:12995:0:(genops.c:885:class_export_put()) final put ffff9c73ada85000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788638591.972617:0:12995:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73ada85000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788638591.972629:0:12995:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:00000080:0.0:1788638591.972693:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73b4e1c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:1.0:1788638591.972722:0:12995:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788638591.972726:0:12995:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788638591.972729:0:12995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788638591.972732:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788638591.972735:0:12995:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788638591.972740:0:12995:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9c73837f4000 69cfc228-c5da-4a8f-95bc-89dfb88a5f68 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788638591.972746:0:12995:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9c7387d499c0) has exports, disconnecting them 00000020:00080000:1.0:1788638591.972750:0:12995:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9c73837f4000), last request at 1788638360 00000020:00000080:1.0:1788638591.972763:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a503 00000020:00010000:1.0:1788638591.972773:0:12995:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9c73837f4000: total 0 00000100:00080000:1.0:1788638591.972776:0:12995:0:(import.c:65:import_set_state_nolock()) ffff9c73837f7000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788638591.972975:0:12995:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c73837f4000): rc 0 00000020:00080000:1.0:1788638591.972981:0:12995:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9c7387d499c0) has no exports 00000100:00100000:0.0:1788638591.973138:0:5835:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9c73c0a4be00:5835] 1 exiting: rc = 0 00000020:00010000:3.0:1788638591.973413:0:5830:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9c73837f4000: total 0 00010000:00010000:3.0:1788638591.973457:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9c73837f4000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788638591.973497:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73bc01d600/0xa0b1f1e3b4b2aa58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2aa51 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638591.973561:0:5837:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9c7383572200:5837] 2 exiting: rc = 0 00010000:00010000:3.0:1788638591.973733:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7381685c00/0xa0b1f1e3b4b2a60d lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a606 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638591.973766:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7385308600/0xa0b1f1e3b4b2a867 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a860 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638591.974114:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73829f1e00/0xa0b1f1e3b4b2a813 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a80c expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638591.974173:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7381685e00/0xa0b1f1e3b4b2a821 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a81a expref: 5 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638591.974174:0:5834:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9c73853f1600:5834] 0 exiting: rc = 1 00010000:00010000:3.0:1788638591.974206:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7385309200/0xa0b1f1e3b4b2a83d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a836 expref: 4 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638591.974222:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7399aa6800/0xa0b1f1e3b4b2aa4a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2aa43 expref: 3 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638591.974388:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974396:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974402:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974407:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974412:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974426:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974431:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974436:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974442:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974447:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974453:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974458:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974463:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974469:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974475:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974480:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974486:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974492:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974498:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974505:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974510:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974516:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974522:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974528:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974535:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974540:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974561:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974569:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974595:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974616:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974635:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974643:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974649:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974655:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974661:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974667:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974673:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974690:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974696:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974714:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974721:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974739:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974745:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974751:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974770:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.974775:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00010000:00010000:3.0:1788638591.975067:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7385308e00/0xa0b1f1e3b4b2a82f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2a828 expref: 2 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638591.975082:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9c73837f4000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788638591.975103:0:5830:0:(genops.c:885:class_export_put()) final put ffff9c73837f4000/69cfc228-c5da-4a8f-95bc-89dfb88a5f68 00010000:00010000:3.0:1788638591.975191:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638591.975194:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638591.975209:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638591.975428:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.975437:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.975442:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.975447:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.975453:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.975458:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.975463:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.975468:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.975473:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.975479:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.975487:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.975492:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.975497:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.975502:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.975507:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.975512:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.975517:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638591.975534:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788638591.976122:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73837f4000/69cfc228-c5da-4a8f-95bc-89dfb88a5f68 for MGS 00000020:00000080:2.0:1788638591.976292:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73837f7000 for MGS 20000000:01000000:0.0:1788638591.976535:0:12995:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788638591.976539:0:12995:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1788638591.979746:0:12995:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c73b4d0f4e0 - data ffff9c73bf83b510/ffff9c73ad5fc400 00000020:01000000:2.0:1788638591.980454:0:12995:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c738672a720 - data ffff9c738ec180d8/ffff9c73837edc00 00000020:00000080:2.0:1788638591.980981:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a4e7 00000020:00000080:2.0:1788638591.981037:0:12995:0:(genops.c:885:class_export_put()) final put ffff9c739173d000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788638591.981053:0:12995:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c7387a11800 from MGS, refs=2 00000020:01000004:2.0:1788638591.981057:0:12995:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7387a11800 2 00000020:01000004:2.0:1788638591.981060:0:12995:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c7387a11800 from MGS 00000020:00000080:2.0:1788638591.981083:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788638591.981089:0:12995:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788638591.981092:0:12995:0:(genops.c:885:class_export_put()) final put ffff9c739173d800/MGS 00000020:00000080:2.0:1788638591.981095:0:12995:0:(genops.c:844:class_export_destroy()) destroying export ffff9c739173d800/MGS for MGS 00000020:01000000:2.0:1788638591.981102:0:12995:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788638591.981152:0:12995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788638591.981156:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788638591.981161:0:12995:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788638591.981168:0:12995:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9c7398783800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788638591.981174:0:12995:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9c73880a99c0) has exports, disconnecting them 00000020:00080000:2.0:1788638591.981178:0:12995:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9c7398783800), last request at 1788638361 00000020:00000080:2.0:1788638591.981193:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a5b2 00000020:00080000:2.0:1788638591.981199:0:12995:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c7398783800): rc 0 00000020:00000080:2.0:1788638591.981203:0:12995:0:(genops.c:885:class_export_put()) final put ffff9c7398783800/lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788638591.981810:0:12995:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788638591.981925:0:12995:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788638591.981930:0:12995:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788638591.981935:0:12995:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788638591.982061:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788638591.982066:0:12995:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788638591.982070:0:12995:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c7387a11800 1 00000020:00000080:2.0:1788638591.982074:0:12995:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a4d9 00000020:00000080:2.0:1788638591.982078:0:12995:0:(genops.c:885:class_export_put()) final put ffff9c739173f800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788638591.982081:0:12995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788638591.982085:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788638591.982088:0:12995:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788638591.982090:0:12995:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9c73880acd40) has no exports 00000020:00000080:0.0:1788638591.982678:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c739173d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788638591.982688:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7398783800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788638591.982693:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c7398781000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788638591.982698:0:37:0:(genops.c:885:class_export_put()) final put ffff9c73acdc7800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788638591.982700:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73acdc7800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788638591.982706:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788638591.982759:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9c739173f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788638592.023217:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788638592.023230:0:12995:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788638592.023235:0:12995:0:(genops.c:885:class_export_put()) final put ffff9c7387a10800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788638592.023239:0:12995:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7387a10800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788638592.023245:0:12995:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788638592.023362:0:12995:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c7387a17800 00000020:01000000:0.0:1788638592.023380:0:12995:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788638592.023384:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788638592.023388:0:12995:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788638592.023393:0:12995:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9c7383758000) has no exports 00000100:00100000:2.0:1788638592.026075:0:5843:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9c73836b1400:5843] 1 exiting: rc = 0 00000100:00100000:0.0:1788638592.026371:0:5842:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9c7383762000:5842] 0 exiting: rc = 1 00000100:00100000:3.0:1788638592.026532:0:5844:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9c73836b0c00:5844] 2 exiting: rc = 0 00000100:00100000:1.0:1788638592.026704:0:7634:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9c73ad39be00:7634] 3 exiting: rc = 0 00000100:00100000:0.0:1788638592.027069:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027076:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027081:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027086:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027090:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027096:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027102:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027107:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027112:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027118:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027141:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027146:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027151:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027156:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027161:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027166:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027172:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027178:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027183:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027188:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027193:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027197:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027202:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027207:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027211:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027218:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027225:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027231:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027236:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027240:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027246:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027250:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027256:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027262:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027268:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027273:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027279:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027284:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027289:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027294:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027299:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027304:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027310:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027316:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027321:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027335:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027341:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027346:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027351:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027356:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027361:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027367:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027373:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027378:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027385:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027391:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027396:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027401:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027406:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027411:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027417:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027422:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027427:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.027433:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.031409:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9c7383760600:5846] 1 exiting: rc = 0 00000100:00100000:3.0:1788638592.031553:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9c73836b1a00:5845] 0 exiting: rc = 1 00000100:00100000:0.0:1788638592.031714:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.031722:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.031728:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.031734:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.031739:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.031745:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.031752:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.031758:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.031764:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.031770:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.031775:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.031938:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.031946:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.031951:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.031965:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.031972:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032000:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032007:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032012:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032018:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032023:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032028:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032033:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032038:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032043:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032048:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032054:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032059:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032065:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032070:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032074:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032079:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032084:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032089:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032094:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032100:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032105:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032111:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032116:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032121:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032125:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032129:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032134:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032140:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032145:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032150:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032156:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032161:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032165:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032170:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032175:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032189:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032194:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032199:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032204:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032209:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032214:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032220:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032225:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032230:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032235:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032239:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032244:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.032249:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.032853:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9c738372b200:5848] 1 exiting: rc = 0 00000100:00100000:0.0:1788638592.032979:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9c7383760a00:5847] 0 exiting: rc = 1 00000100:00100000:2.0:1788638592.033077:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033085:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033099:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033115:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033122:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033128:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033134:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033140:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033145:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033151:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033156:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033163:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033170:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033176:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033192:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033215:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033222:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033230:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033240:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033246:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033253:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033259:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033266:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033273:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033278:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033284:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033290:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033313:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033322:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033328:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033334:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033340:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033346:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033351:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033359:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033365:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033371:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033376:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033383:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033407:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033418:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033424:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033430:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033437:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033442:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033448:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033454:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033460:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033465:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033479:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033485:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033506:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033514:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033520:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033527:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033533:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033539:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033547:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033554:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033561:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033567:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033572:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033578:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638592.033583:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638592.041481:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9c738372a800:5849] 0 exiting: rc = 1 00000100:00100000:3.0:1788638592.041589:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9c738372be00:5850] 1 exiting: rc = 0 00000100:00100000:1.0:1788638592.041772:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042364:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042375:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042380:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042386:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042392:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042397:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042403:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042409:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042414:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042420:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042426:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042431:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042436:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042441:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042446:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042451:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042456:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042461:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042466:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042471:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042477:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042481:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042486:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042491:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042496:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042514:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042519:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042524:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042529:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042534:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042539:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042544:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042549:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042555:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042560:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042564:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042569:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042574:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042580:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042584:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042590:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042595:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042600:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042605:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042685:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042693:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042698:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042703:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042708:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042713:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042719:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042724:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042729:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042734:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042739:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042744:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042749:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042755:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042760:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042764:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042778:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042978:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.042984:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.043639:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9c738372a200:5851] 0 exiting: rc = 1 00000100:00100000:0.0:1788638592.043772:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9c738372ec00:5852] 1 exiting: rc = 0 00000100:00100000:1.0:1788638592.043990:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044005:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044010:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044015:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044022:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044027:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044032:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044037:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044042:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044047:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044052:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044056:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044061:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044066:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044072:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044076:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044082:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044087:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044092:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044097:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044102:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044107:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044112:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044117:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044122:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044127:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044132:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044137:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044143:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044148:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044153:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044158:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044174:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044179:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044184:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044189:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044193:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044198:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044203:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044208:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044213:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044218:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044222:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044227:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044231:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044237:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044242:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044247:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044251:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044256:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044260:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044265:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044270:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044274:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044279:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044284:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044289:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044294:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044298:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044304:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044309:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044314:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044319:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638592.044325:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.044752:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9c738372fa00:5853] 0 exiting: rc = 1 00000100:00100000:2.0:1788638592.045145:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9c738372e800:5854] 1 exiting: rc = 0 00000100:00100000:3.0:1788638592.045239:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045245:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045251:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045256:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045261:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045266:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045272:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045277:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045292:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045298:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045303:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045308:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045313:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045318:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045322:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045327:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045332:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045337:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045342:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045347:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045352:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045357:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045363:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045368:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045373:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045377:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045381:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045386:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045391:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045396:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045401:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045407:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045412:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045418:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045423:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045428:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045432:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045437:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045442:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045446:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045451:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045457:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045461:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045475:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045480:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045485:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045490:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045494:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045499:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045504:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045510:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045514:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045519:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045524:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045529:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045534:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045539:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045543:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045548:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045553:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045557:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045561:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045566:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.045572:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.046002:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9c738372ea00:5855] 0 exiting: rc = 1 00000100:00100000:3.0:1788638592.046198:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9c7390e40a00:5857] 2 exiting: rc = 0 00000100:00100000:2.0:1788638592.046756:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9c738372e200:5856] 1 exiting: rc = 0 00000100:00100000:3.0:1788638592.047355:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047362:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047368:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047373:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047379:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047400:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047408:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047413:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047420:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047426:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047431:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047436:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047452:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047458:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047464:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047469:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047476:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047481:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047486:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047492:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047497:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047503:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047509:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047514:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047520:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047525:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047530:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047536:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047542:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047564:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047571:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047577:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047582:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047588:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047594:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047600:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047606:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047686:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047695:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047700:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047705:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047710:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047715:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047719:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047724:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047730:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047735:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047749:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047754:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047760:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047766:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047770:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.047776:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.048010:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.048018:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.048023:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.048029:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.048034:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.048039:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.048045:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.048050:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.048056:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.048062:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638592.048076:0:12995:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788638592.055508:0:12995:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788638592.055520:0:12995:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788638592.055525:0:12995:0:(genops.c:885:class_export_put()) final put ffff9c73a6099800/MDS_uuid 00000020:00000080:2.0:1788638592.055530:0:12995:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73a6099800/MDS_uuid for MDS 00000020:01000000:2.0:1788638592.055542:0:12995:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788638592.055721:0:12995:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:3.0:1788638592.932046:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638593.954879:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638594.976018:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788638595.201481:0:13151:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788638595.217580:0:13151:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788638595.217629:0:13151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2a828 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a82f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638595.217662:0:13151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2a828 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a82f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638595.217669:0:13151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2a828 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2a82f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638595.217675:0:13151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2a828 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2a82f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638595.217698:0:13151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788638595.217703:0:13151:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788638595.217725:0:13151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788638595.217730:0:13151:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788638595.217737:0:13151:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788638595.217742:0:13151:0:(import.c:65:import_set_state_nolock()) ffff9c73b7e9b800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788638595.217747:0:13151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788638595.217748:0:13151:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788638595.217752:0:13151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788638595.218578:0:13151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fc600/0xa0b1f1e3b4b2a836 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a83d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638595.218590:0:13151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fc600/0xa0b1f1e3b4b2a836 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a83d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638595.218598:0:13151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73813fc600/0xa0b1f1e3b4b2a836 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2a83d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638595.218604:0:13151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: ffff9c73813fc600/0xa0b1f1e3b4b2a836 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2a83d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638595.218626:0:13151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788638595.218632:0:13151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385308200/0xa0b1f1e3b4b2aa51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2aa58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638595.218639:0:13151:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385308200/0xa0b1f1e3b4b2aa51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2aa58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638595.218644:0:13151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385308200/0xa0b1f1e3b4b2aa51 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2aa58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638595.218650:0:13151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: ffff9c7385308200/0xa0b1f1e3b4b2aa51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2aa58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638595.218672:0:13151:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:1.0:1788638595.218677:0:13151:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788638595.218694:0:13151:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788638595.218698:0:13151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788638595.218703:0:13151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788638595.218708:0:13151:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788638595.218713:0:13151:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9c73ad9c4d40) has no exports 00000020:00080000:1.0:1788638595.218736:0:13151:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9c73ad9c4d40) has no exports 00000020:01000000:1.0:1788638595.220321:0:13151:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c73b4d0fd20 - data ffff9c73a7ba46c0/ffff9c73ad5ff400 00000020:01000000:1.0:1788638595.220488:0:13151:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c73917e7d20 - data ffff9c73bf802360/ffff9c73bf27f000 00010000:00010000:2.0:1788638595.220876:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788638595.220885:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2a828 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2a82f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638595.220896:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7c00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:2.0:1788638595.220901:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2a828 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2a82f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638595.220912:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2a828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2a82f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788638595.220934:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2a828 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2a82f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638595.220940:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788638595.220943:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788638595.220946:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788638595.220995:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2a828 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2a82f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638595.221002:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788638595.221029:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2a828 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2a82f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638595.221036:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2a828 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2a82f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638595.221049:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788638595.221052:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c73813fc600/0xa0b1f1e3b4b2a836 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2a83d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638595.221058:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fc600 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:2.0:1788638595.221061:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c73813fc600/0xa0b1f1e3b4b2a836 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2a83d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638595.221067:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c73813fc600/0xa0b1f1e3b4b2a836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2a83d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788638595.221072:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c73813fc600/0xa0b1f1e3b4b2a836 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2a83d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638595.221088:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788638595.221090:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788638595.221092:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788638595.221107:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c73813fc600/0xa0b1f1e3b4b2a836 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2a83d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638595.221114:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788638595.221120:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c73813fc600/0xa0b1f1e3b4b2a836 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2a83d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638595.221126:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c73813fc600/0xa0b1f1e3b4b2a836 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2a83d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638595.221137:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638595.221141:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7385308200/0xa0b1f1e3b4b2aa51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2aa58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638595.221146:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308200 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:2.0:1788638595.221149:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7385308200/0xa0b1f1e3b4b2aa51 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2aa58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638595.221155:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7385308200/0xa0b1f1e3b4b2aa51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2aa58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788638595.221161:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7385308200/0xa0b1f1e3b4b2aa51 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2aa58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638595.221166:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788638595.221168:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788638595.221169:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788638595.221186:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7385308200/0xa0b1f1e3b4b2aa51 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2aa58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638595.221191:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788638595.221205:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7385308200/0xa0b1f1e3b4b2aa51 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2aa58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638595.221212:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7385308200/0xa0b1f1e3b4b2aa51 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xa0b1f1e3b4b2aa58 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638595.221219:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638595.221221:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638595.221223:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638595.221241:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183663232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788638595.221306:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638595.221354:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788638595.221360:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183663360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788638595.221382:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638595.221411:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183663488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788638595.221431:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638595.221463:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183663232 00000100:00100000:2.0:1788638595.221469:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183663232 00000100:00100000:2.0:1788638595.221500:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183663360 00000100:00100000:2.0:1788638595.221503:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183663360 00000100:00100000:2.0:1788638595.221510:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183663488 00000100:00100000:2.0:1788638595.221512:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183663488 00000100:00100000:2.0:1788638595.221524:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788638595.221530:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dfa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3291:x1875523183663232:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788638595.221537:0:5828:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788638595 with bad export cookie 11579302077237732611 00010000:00010000:0.0:1788638595.223336:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638595.223459:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788638595.223468:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385379500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3291:x1875523183663360:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788638595.223475:0:5827:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788638595 with bad export cookie 11579302077237732611 00000100:00100000:0.0:1788638595.223566:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385379500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3291:x1875523183663360:12345-0@lo:103:ldlm_bl.0 Request processed in 97us (2181us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788638595.223573:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788638595.223595:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788638595.223600:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3293:x1875523183663488:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788638595.223604:0:5827:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788638595 with bad export cookie 11579302077237732611 00000100:00100000:0.0:1788638595.223636:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3293:x1875523183663488:12345-0@lo:103:ldlm_bl.0 Request processed in 34us (2203us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788638595.223641:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788638595.223717:0:3291:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.134@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788638595.223722:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9c73a609a000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788638595.223725:0:3291:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.134@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1788638595.223826:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788638595.224606:0:3293:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.134@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:2.0:1788638595.251740:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dfa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3291:x1875523183663232:12345-0@lo:103:ldlm_bl.0 Request processed in 30200us (30425us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788638595.251772:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788638595.276333:0:3291:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.134@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788638595.276338:0:3291:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788638595.276347:0:3291:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7385378a80 x1875523183663232/t0(0) o103->MGC192.168.203.134@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788638611 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638595.276362:0:3291:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c738537a300 x1875523183663360/t0(0) o103->MGC192.168.203.134@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788638611 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638595.276370:0:3291:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c738537b800 x1875523183663488/t0(0) o103->MGC192.168.203.134@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788638611 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788638595.276501:0:3291:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788638595.276504:0:3291:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788638595.276505:0:3291:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788638595.278196:0:3293:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9c73a609a000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:0.0:1788638595.278421:0:3291:0:(import.c:65:import_set_state_nolock()) ffff9c73a609a000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788638595.278431:0:3291:0:(import.c:545:import_select_connection()) MGC192.168.203.134@tcp: connect to NID 0@lo last attempt 123 00000100:00080000:0.0:1788638595.278440:0:3291:0:(import.c:665:import_select_connection()) MGC192.168.203.134@tcp: import ffff9c73a609a000 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:0.0:1788638595.278468:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3293:1875523183663488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788638595.278946:0:3291:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7385378e00 x1875523183663616/t0(0) o250->MGC192.168.203.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788638595.278995:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183663232:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788638595.279010:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3291:1875523183663360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788638595.279036:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3290:1875523183663616:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1788638595.279082:0:3290:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875523183663616 offset 0 length 520: 4 00100000:10000000:2.0:1788638595.297279:0:13151:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788638595.332555:0:13151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a629 00000020:00000080:0.0:1788638595.332568:0:13151:0:(genops.c:885:class_export_put()) final put ffff9c73b7e9f000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1788638595.332594:0:13151:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c73bce5d800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1788638595.332599:0:13151:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c73bce5d800 2 00000020:01000004:0.0:1788638595.332602:0:13151:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c73bce5d800 from lustre-OST0000 00000020:00000080:0.0:1788638595.332633:0:13151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788638595.332643:0:13151:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1788638595.332647:0:13151:0:(genops.c:885:class_export_put()) final put ffff9c73b4e1b000/lustre-OST0000_UUID 00000020:00000080:0.0:1788638595.332664:0:13151:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73b4e1b000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1788638595.332672:0:13151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1788638595.332731:0:13151:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1788638595.332736:0:13151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1788638595.332740:0:13151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788638595.332746:0:13151:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788638595.332754:0:13151:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9c73b7e9e000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788638595.332760:0:13151:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9c73ad9c19c0) has exports, disconnecting them 00000020:00080000:0.0:1788638595.332765:0:13151:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9c73b7e9e000), last request at 1788638377 00000020:00000080:0.0:1788638595.332770:0:13151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a653 00000020:00080000:0.0:1788638595.332803:0:13151:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c73b7e9e000): rc 0 00000020:00000080:0.0:1788638595.332809:0:13151:0:(genops.c:885:class_export_put()) final put ffff9c73b7e9e000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788638595.333098:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73b7e9f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788638595.333106:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73b7e9e000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1788638595.342311:0:13151:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788638595.342320:0:13151:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788638595.342324:0:13151:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788638595.342331:0:13151:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788638595.342434:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73b7e9b800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788638595.342627:0:13151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788638595.342637:0:13151:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788638595.342643:0:13151:0:(genops.c:885:class_export_put()) final put ffff9c73b7e9f800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788638595.342647:0:13151:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73b7e9f800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788638595.342654:0:13151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1788638595.342720:0:13151:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c73bce5d800 1 00000020:00000080:0.0:1788638595.342727:0:13151:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a5e3 00000020:00000080:0.0:1788638595.342734:0:13151:0:(genops.c:885:class_export_put()) final put ffff9c7398b8d800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788638595.342748:0:13151:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788638595.342753:0:13151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788638595.342758:0:13151:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788638595.342761:0:13151:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9c73bce38000) has no exports 00000020:00000080:3.0:1788638595.342818:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7398b8d800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788638595.387989:0:13151:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788638595.388005:0:13151:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788638595.388011:0:13151:0:(genops.c:885:class_export_put()) final put ffff9c73bce5f800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788638595.388015:0:13151:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73bce5f800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788638595.388025:0:13151:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788638595.388164:0:13151:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c73bce59800 00000020:02000400:3.0:1788638595.388217:0:13151:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788638596.004678:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788638596.328845:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 69cfc228-c5da-4a8f-95bc-89dfb88a5f68->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788638596.328866:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 69cfc228-c5da-4a8f-95bc-89dfb88a5f68->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788638596.328869:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788638596.328873:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788638596.328877:0:8:0:(import.c:65:import_set_state_nolock()) ffff9c73ad654000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788638596.328886:0:8:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 354 00000100:00080000:0.0:1788638596.328893:0:8:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788638596.328900:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c73ad654000 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:0.0:1788638596.328947:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73bf61c700 x1875523183663744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788638596.329912:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1875523183663744:0@lo:38:kworker.0 00000400:00000100:1.0:1788638596.329983:0:3290:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875523183663744 offset 0 length 520: 4 00010000:00010000:0.0:1788638597.025397:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638598.050179:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788638598.287407:0:13300:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788638598.298939:0:13300:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1788638598.299217:0:13300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7381685a00/0xa0b1f1e3b4b2a80c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a813 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638598.299231:0:13300:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7381685a00/0xa0b1f1e3b4b2a80c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a813 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638598.299239:0:13300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7381685a00/0xa0b1f1e3b4b2a80c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2a813 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638598.299246:0:13300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: ffff9c7381685a00/0xa0b1f1e3b4b2a80c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2a813 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638598.299268:0:13300:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788638598.299274:0:13300:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788638598.299301:0:13300:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788638598.299312:0:13300:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c73bf61c700 x1875523183663744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788638616 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638598.299330:0:13300:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788638598.299346:0:13300:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788638598.299352:0:13300:0:(import.c:65:import_set_state_nolock()) ffff9c73ad654000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1788638598.299356:0:13300:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788638598.299361:0:13300:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c73bf61c700 x1875523183663744/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788638616 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638598.299369:0:13300:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788638598.299372:0:13300:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00000100:00100000:0.0:1788638598.299840:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1875523183663744:0@lo:38:kworker.0 00010000:00010000:2.0:1788638598.301591:0:13300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a81a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2a821 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638598.301611:0:13300:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a81a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2a821 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638598.301619:0:13300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a81a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2a821 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638598.301626:0:13300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a81a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2a821 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638598.301653:0:13300:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788638598.301659:0:13300:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385308400/0xa0b1f1e3b4b2aa43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2aa4a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638598.301666:0:13300:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385308400/0xa0b1f1e3b4b2aa43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2aa4a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638598.301671:0:13300:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385308400/0xa0b1f1e3b4b2aa43 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2aa4a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638598.301678:0:13300:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.134@tcp lock: ffff9c7385308400/0xa0b1f1e3b4b2aa43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa0b1f1e3b4b2aa4a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638598.301703:0:13300:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:2.0:1788638598.301708:0:13300:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788638598.301735:0:13300:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788638598.301740:0:13300:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788638598.301745:0:13300:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788638598.301751:0:13300:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788638598.301755:0:13300:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9c73880ab380) has no exports 00000020:00080000:2.0:1788638598.301779:0:13300:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9c73880ab380) has no exports 00010000:00010000:0.0:1788638598.302032:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788638598.302040:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7381685a00/0xa0b1f1e3b4b2a80c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2a813 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638598.302047:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7381685a00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:0.0:1788638598.302051:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7381685a00/0xa0b1f1e3b4b2a80c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2a813 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638598.302059:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7381685a00/0xa0b1f1e3b4b2a80c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2a813 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638598.302066:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7381685a00/0xa0b1f1e3b4b2a80c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2a813 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638598.302071:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788638598.302073:0:7639:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788638598.302083:0:7639:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788638598.302095:0:7639:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c73a609a000 00010000:00010000:0.0:1788638598.302099:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7381685a00/0xa0b1f1e3b4b2a80c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa0b1f1e3b4b2a813 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638598.302105:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7381685a00/0xa0b1f1e3b4b2a80c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa0b1f1e3b4b2a813 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638598.302120:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788638598.302123:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a81a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2a821 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638598.302127:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73829f0e00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:0.0:1788638598.302130:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a81a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2a821 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638598.302136:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a81a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2a821 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638598.302219:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a81a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2a821 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638598.302225:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788638598.302227:0:7639:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1788638598.302229:0:7639:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1788638598.302235:0:7639:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c73a609a000 00010000:00010000:0.0:1788638598.302238:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a81a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa0b1f1e3b4b2a821 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638598.302244:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c73829f0e00/0xa0b1f1e3b4b2a81a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa0b1f1e3b4b2a821 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638598.302265:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638598.302269:0:7639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7385308400/0xa0b1f1e3b4b2aa43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2aa4a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638598.302274:0:7639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308400 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:0.0:1788638598.302276:0:7639:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7385308400/0xa0b1f1e3b4b2aa43 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa0b1f1e3b4b2aa4a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638598.302283:0:7639:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7385308400/0xa0b1f1e3b4b2aa43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2aa4a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638598.302289:0:7639:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7385308400/0xa0b1f1e3b4b2aa43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2aa4a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638598.302295:0:7639:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788638598.302297:0:7639:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788638598.302299:0:7639:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788638598.302305:0:7639:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c73a609a000 00010000:00010000:0.0:1788638598.302308:0:7639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7385308400/0xa0b1f1e3b4b2aa43 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa0b1f1e3b4b2aa4a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638598.302315:0:7639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7385308400/0xa0b1f1e3b4b2aa43 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa0b1f1e3b4b2aa4a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638598.302326:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638598.302328:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638598.302330:0:7639:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638598.305697:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638598.305708:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788638598.306637:0:13300:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c73b4d0fba0 - data ffff9c73bfa0b870/ffff9c73b486ac00 00000020:01000000:3.0:1788638598.306811:0:13300:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9c73ad6f70c0 - data ffff9c73bf8a1360/ffff9c73b7e30c00 00100000:10000000:3.0:1788638598.327393:0:13300:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788638598.373360:0:13300:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a702 00000020:00000080:0.0:1788638598.373370:0:13300:0:(genops.c:885:class_export_put()) final put ffff9c73b4c0e000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788638598.373402:0:13300:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c73b4c0d800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788638598.373406:0:13300:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c73b4c0d800 2 00000020:01000004:0.0:1788638598.373409:0:13300:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9c73b4c0d800 from lustre-OST0001 00000020:00000080:0.0:1788638598.373434:0:13300:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788638598.373444:0:13300:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788638598.373447:0:13300:0:(genops.c:885:class_export_put()) final put ffff9c73bc021000/lustre-OST0001_UUID 00000020:00000080:0.0:1788638598.373451:0:13300:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73bc021000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788638598.373457:0:13300:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788638598.373556:0:13300:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 69cfc228-c5da-4a8f-95bc-89dfb88a5f68->MGS 00010000:00010000:0.0:1788638598.373571:0:13300:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7380031600/0xa0b1f1e3b4b2a606 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2a60d expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638598.373582:0:13300:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7380031600/0xa0b1f1e3b4b2a606 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2a60d expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638598.373588:0:13300:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788638598.373591:0:13300:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788638598.373594:0:13300:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788638598.373606:0:13300:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c73a609a000 00010000:00010000:0.0:1788638598.373609:0:13300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7380031600/0xa0b1f1e3b4b2a606 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa0b1f1e3b4b2a60d expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638598.373624:0:13300:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c73813fd200/0xa0b1f1e3b4b2a860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa0b1f1e3b4b2a867 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788638598.373630:0:13300:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c73813fd200/0xa0b1f1e3b4b2a860 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa0b1f1e3b4b2a867 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638598.373635:0:13300:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788638598.373637:0:13300:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788638598.373639:0:13300:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788638598.373647:0:13300:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9c73a609a000 00010000:00010000:0.0:1788638598.373657:0:13300:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c73813fd200/0xa0b1f1e3b4b2a860 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa0b1f1e3b4b2a867 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788638598.373674:0:13300:0:(import.c:65:import_set_state_nolock()) ffff9c73a609a000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788638598.373678:0:13300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788638598.373680:0:13300:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788638598.373681:0:13300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788638598.373685:0:13300:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788638598.373696:0:13300:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9c7385378e00 x1875523183663616/t0(0) o250->MGC192.168.203.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788638605 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788638598.373713:0:13300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788638598.373716:0:13300:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:2.0:1788638598.373822:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73b4c0e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1788638598.374199:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:69cfc228-c5da-4a8f-95bc-89dfb88a5f68:3290:1875523183663616:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:0.0:1788638598.374244:0:13300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788638598.374251:0:13300:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a4f5 00000020:00000080:0.0:1788638598.374256:0:13300:0:(genops.c:885:class_export_put()) final put ffff9c73a609e000/69cfc228-c5da-4a8f-95bc-89dfb88a5f68 00000020:01000000:0.0:1788638598.374270:0:13300:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.134@tcp (flags='') 00000020:00000080:0.0:1788638598.374275:0:13300:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788638598.374319:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73a609e000/69cfc228-c5da-4a8f-95bc-89dfb88a5f68 for MGC192.168.203.134@tcp 00000020:00000080:0.0:1788638598.374343:0:13300:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.134@tcp: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788638598.374347:0:13300:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9c738375b380) has no exports 10000000:01000000:3.0:1788638598.374480:0:5840:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788638598.374892:0:13300:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.134@tcp: client import never connected 00000100:00080000:0.0:1788638598.374895:0:13300:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788638598.374897:0:13300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788638598.374899:0:13300:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788638598.374901:0:13300:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788638598.375109:0:13300:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788638598.375114:0:13300:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.134@tcp (uuid 69cfc228-c5da-4a8f-95bc-89dfb88a5f68) 00000020:01000000:0.0:1788638598.375120:0:13300:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788638598.375123:0:13300:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788638598.375126:0:13300:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788638598.375131:0:13300:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9c73ad652800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788638598.375136:0:13300:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9c7385323380) has exports, disconnecting them 00000020:00080000:0.0:1788638598.375140:0:13300:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9c73ad652800), last request at 1788638395 00000020:00000080:0.0:1788638598.375154:0:13300:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a72c 00000020:00080000:0.0:1788638598.375165:0:13300:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9c73ad652800): rc 0 00000020:00000080:0.0:1788638598.375168:0:13300:0:(genops.c:885:class_export_put()) final put ffff9c73ad652800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788638598.375898:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73a609a000 for MGC192.168.203.134@tcp 00000020:00000080:3.0:1788638598.375908:0:8:0:(genops.c:885:class_export_put()) final put ffff9c73a609b000/69cfc228-c5da-4a8f-95bc-89dfb88a5f68 00000020:00000080:3.0:1788638598.375987:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73a609b000/69cfc228-c5da-4a8f-95bc-89dfb88a5f68 for MGC192.168.203.134@tcp 00000020:01000000:3.0:1788638598.375997:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.134@tcp (69cfc228-c5da-4a8f-95bc-89dfb88a5f68) 00000020:00000080:3.0:1788638598.377139:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73ad652800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788638598.409890:0:13300:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788638598.409901:0:13300:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788638598.409905:0:13300:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788638598.409912:0:13300:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788638598.409995:0:7639:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:2.0:1788638598.410024:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9c73ad654000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1788638598.410150:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1788638598.410284:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1788638598.410459:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9c7387d40000:5825] 0 exiting: rc = 1 00000100:00100000:0.0:1788638598.410907:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9c73982b1000:5826] 1 exiting: rc = 0 00000100:00100000:3.0:1788638598.411047:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638598.411445:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9c73982b1600:5827] 0 exiting: rc = 1 00000100:00100000:2.0:1788638598.411502:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9c73982b0400:5828] 1 exiting: rc = 0 00000100:00100000:0.0:1788638598.415106:0:11689:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9c7398b85c00:11689] 3 exiting: rc = 0 00000100:00100000:0.0:1788638598.415268:0:5829:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9c7384d93c00:5829] 2 exiting: rc = 0 00000100:00100000:3.0:1788638598.418644:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418656:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418663:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418669:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418676:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418682:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418687:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418693:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418717:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418723:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418729:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418735:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418741:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418747:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418753:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418759:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418766:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418772:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418778:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418799:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418806:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418811:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418816:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418821:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418826:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418833:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418837:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418842:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418847:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418852:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418856:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418861:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418866:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418872:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418877:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418884:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.418890:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419125:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419133:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419139:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419145:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419149:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419154:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419166:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419171:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419176:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419180:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419185:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419189:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419194:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419199:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419205:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419211:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419216:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419221:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419227:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419233:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419238:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419243:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419249:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419254:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419260:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419265:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.419270:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788638598.420154:0:13300:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788638598.420163:0:13300:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788638598.420168:0:13300:0:(genops.c:885:class_export_put()) final put ffff9c73bf66b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788638598.420173:0:13300:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73bf66b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788638598.420177:0:13300:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788638598.420214:0:13300:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c73b4c0d800 1 00000020:00000080:3.0:1788638598.420219:0:13300:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa0b1f1e3b4b2a6d1 00000020:00000080:3.0:1788638598.420225:0:13300:0:(genops.c:885:class_export_put()) final put ffff9c73b7e98000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788638598.420242:0:13300:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788638598.420247:0:13300:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788638598.420251:0:13300:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788638598.420254:0:13300:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9c73853219c0) has no exports 00000020:00000080:2.0:1788638598.420461:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73b7e98000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788638598.446017:0:13300:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788638598.446043:0:13300:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788638598.446048:0:13300:0:(genops.c:885:class_export_put()) final put ffff9c73b4c09800/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788638598.446053:0:13300:0:(genops.c:844:class_export_destroy()) destroying export ffff9c73b4c09800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788638598.446063:0:13300:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788638598.446222:0:13300:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9c73b4c0f000 00000020:01000000:3.0:1788638598.446243:0:13300:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788638598.446247:0:13300:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788638598.446251:0:13300:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788638598.446255:0:13300:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9c73ad9c0000) has no exports 00000020:00000080:3.0:1788638598.446275:0:13300:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788638598.446281:0:13300:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788638598.446283:0:13300:0:(genops.c:885:class_export_put()) final put ffff9c7398b8a800/OSS_uuid 00000020:00000080:3.0:1788638598.446286:0:13300:0:(genops.c:844:class_export_destroy()) destroying export ffff9c7398b8a800/OSS_uuid for OSS 00000020:01000000:3.0:1788638598.446289:0:13300:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1788638598.446357:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9c7384d62c00:6687] 2 exiting: rc = 0 00000100:00100000:3.0:1788638598.446436:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9c7387d2ca00:6684] 0 exiting: rc = 1 00000100:00080000:2.0:1788638598.448631:0:5838:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1788638598.449653:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9c7384d63800:6686] 1 exiting: rc = 0 00000100:00100000:0.0:1788638598.449740:0:11999:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9c73ad466000:11999] 3 exiting: rc = 0 00000100:00100000:3.0:1788638598.453382:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453394:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453401:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453407:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453413:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453419:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453424:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453429:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453434:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453439:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453444:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453449:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453455:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453462:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453467:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453473:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453479:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453484:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453504:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453509:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453514:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453518:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453584:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453592:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453597:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453602:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453607:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453611:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453616:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453623:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453628:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453633:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453637:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453641:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453646:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453650:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453655:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453659:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453665:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453669:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453674:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453679:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453685:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453689:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453694:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453700:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453705:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453710:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453715:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453719:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453724:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453729:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453734:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453746:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453751:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453756:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453761:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453765:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453770:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453774:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453780:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453866:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453872:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.453877:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.455281:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9c7398303e00:6688] 0 exiting: rc = 1 00000100:00100000:0.0:1788638598.456877:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9c7398302c00:6689] 1 exiting: rc = 0 00000100:00100000:1.0:1788638598.457068:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457085:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457091:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457096:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457102:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457107:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457112:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457117:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457122:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457126:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457131:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457136:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457141:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457146:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457152:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457157:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457163:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457167:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457172:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457177:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457181:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457186:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457190:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457195:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457200:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457204:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457209:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457213:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457218:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457222:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457227:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457232:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457236:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457241:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457246:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457251:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457260:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457265:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457270:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457275:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457279:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457284:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457289:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457294:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457299:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457304:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457310:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457315:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457320:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457325:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457329:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457334:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457339:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457344:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457348:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457353:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457358:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457362:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457367:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457372:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457376:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457382:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457387:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.457392:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638598.458398:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9c7384d63a00:6690] 0 exiting: rc = 1 00000100:00100000:2.0:1788638598.459501:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9c7384d63e00:6692] 2 exiting: rc = 0 00000100:00100000:2.0:1788638598.459771:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9c7384d62800:6691] 1 exiting: rc = 0 00000100:00100000:1.0:1788638598.460062:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460070:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460077:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460083:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460090:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460095:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460100:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460117:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460122:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460127:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460132:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460138:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460143:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460149:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460154:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460159:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460163:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460168:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460174:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460178:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460183:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460188:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460194:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460199:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460205:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460210:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460216:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460236:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460242:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460248:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460253:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460259:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460264:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460269:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460275:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460280:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460286:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460291:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460296:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460302:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460307:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460313:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460327:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460333:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460339:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460345:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460350:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460355:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460361:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460366:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460371:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460376:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460382:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460395:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460401:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460406:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460424:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460430:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460436:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460441:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460447:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460453:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460459:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788638598.460465:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788638598.466494:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9c7384d63600:6694] 1 exiting: rc = 0 00000100:00100000:2.0:1788638598.466808:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9c7384d62400:6693] 0 exiting: rc = 1 00000100:00100000:3.0:1788638598.467003:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467013:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467019:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467025:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467030:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467036:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467041:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467047:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467052:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467058:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467063:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467069:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467074:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467079:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467084:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467089:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467095:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467101:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467107:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467112:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467117:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467123:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467129:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467134:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467153:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467159:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467165:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467169:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467175:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467180:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467185:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467190:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467195:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467201:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467207:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467212:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467217:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467222:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467228:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467233:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467238:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467243:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467249:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467254:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467260:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467267:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467272:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467277:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467282:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467287:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467292:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467297:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467302:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467307:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467313:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467318:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467323:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467329:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467334:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467349:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467354:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467359:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467365:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.467370:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788638598.468641:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9c7398d4e400:6695] 0 exiting: rc = 1 00000100:00100000:1.0:1788638598.468748:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9c7384d63400:6696] 1 exiting: rc = 0 00000100:00100000:3.0:1788638598.469227:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469235:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469241:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469247:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469252:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469258:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469264:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469269:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469275:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469280:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469301:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469309:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469315:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469320:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469326:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469332:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469337:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469342:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469349:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469354:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469360:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469366:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469385:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469392:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469398:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469404:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469410:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469417:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469423:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469429:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469449:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469456:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469462:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469468:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469488:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469496:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469501:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469507:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469513:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469519:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469524:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469605:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469611:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469617:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469623:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469630:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469651:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469658:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469664:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469670:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469677:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469684:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469689:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469694:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469700:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469709:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469715:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469719:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469739:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469746:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469751:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469756:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469763:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788638598.469769:0:13300:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788638598.480031:0:13300:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788638614.472165:0:13916:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg334-server.virtnet: executing load_modules_local 00000020:01000004:0.0:1788638622.620828:0:14377:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788638622.620833:0:14377:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:0.0:1788638622.620990:0:14377:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c73908d2000 00000020:01000004:0.0:1788638622.621006:0:14377:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:0.0:1788638622.621015:0:14377:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1788638622.621030:0:14377:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9c73bce399c0) 00000020:00000080:0.0:1788638622.621043:0:14377:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788638622.647699:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1788638622.653928:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1788638622.654897:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 441: rc = 0 00100000:10000000:1.0:1788638622.655605:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 441: rc = 0 00100000:10000000:1.0:1788638622.655766:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 441: rc = 0 00100000:10000000:1.0:1788638622.656029:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1788638622.656102:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 441: rc = 0 00100000:10000000:1.0:1788638622.656286:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 441: rc = 0 00100000:10000000:1.0:1788638622.656401:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 441: rc = 0 00100000:10000000:1.0:1788638622.656703:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 443: rc = 0 00100000:10000000:1.0:1788638622.659765:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 461: rc = 0 00100000:10000000:1.0:1788638622.660218:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 461: rc = 0 00100000:10000000:1.0:1788638622.661413:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 675: rc = 0 00100000:10000000:1.0:1788638622.661884:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 675: rc = 0 00100000:10000000:1.0:1788638622.664271:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 675: rc = 0 00100000:10000000:1.0:1788638622.665266:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 675: rc = 0 00100000:10000000:1.0:1788638622.666309:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 675: rc = 0 00100000:10000000:1.0:1788638622.667271:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 675: rc = 0 00100000:10000000:1.0:1788638622.667972:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 675: rc = 0 00100000:10000000:1.0:1788638622.668604:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 675: rc = 0 00100000:10000000:1.0:1788638622.669413:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 675: rc = 0 00100000:10000000:1.0:1788638622.670419:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 675: rc = 0 00100000:10000000:0.0:1788638622.671276:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 675: rc = 0 00100000:10000000:0.0:1788638622.671900:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 675: rc = 0 00100000:10000000:0.0:1788638622.673459:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 691: rc = 0 00100000:10000000:0.0:1788638622.675270:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 691: rc = 0 00100000:10000000:0.0:1788638622.676253:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 691: rc = 0 00100000:10000000:0.0:1788638622.679486:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 691: rc = 0 00100000:10000000:0.0:1788638622.679867:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 691: rc = 0 00100000:10000000:0.0:1788638622.680551:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 691: rc = 0 00100000:10000000:0.0:1788638622.681236:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 691: rc = 0 00100000:10000000:0.0:1788638622.682586:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 691: rc = 0 00100000:10000000:2.0:1788638622.683536:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 691: rc = 0 00100000:10000000:2.0:1788638622.684212:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 691: rc = 0 00100000:10000000:2.0:1788638622.684760:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 691: rc = 0 00100000:10000000:2.0:1788638622.686269:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 691: rc = 0 00100000:10000000:2.0:1788638622.687963:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 691: rc = 0 00100000:10000000:2.0:1788638622.693088:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 691: rc = 0 00100000:10000000:2.0:1788638622.696430:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 691: rc = 0 00100000:10000000:2.0:1788638622.701726:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 691: rc = 0 00100000:10000000:2.0:1788638622.702566:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 691: rc = 0 00100000:10000000:2.0:1788638622.703317:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 691: rc = 0 00100000:10000000:2.0:1788638622.703966:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 691: rc = 0 00100000:10000000:2.0:1788638622.704693:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 691: rc = 0 00100000:10000000:2.0:1788638622.705885:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 691: rc = 0 00100000:10000000:2.0:1788638622.706687:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 691: rc = 0 00100000:10000000:2.0:1788638622.707165:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 691: rc = 0 00100000:10000000:2.0:1788638622.707678:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 691: rc = 0 00100000:10000000:2.0:1788638622.708573:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 691: rc = 0 00100000:10000000:2.0:1788638622.709230:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 691: rc = 0 00100000:10000000:2.0:1788638622.709882:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 691: rc = 0 00100000:10000000:2.0:1788638622.710479:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 691: rc = 0 00100000:10000000:2.0:1788638622.711224:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 691: rc = 0 00100000:10000000:2.0:1788638622.711880:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 691: rc = 0 00100000:10000000:2.0:1788638622.713203:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 691: rc = 0 00100000:10000000:2.0:1788638622.714697:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 691: rc = 0 00100000:10000000:2.0:1788638622.715847:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 471: rc = 0 00100000:10000000:2.0:1788638622.717256:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788638622.717688:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 539: rc = 0 00100000:10000000:2.0:1788638622.722926:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788638622.724217:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 539: rc = 0 00100000:10000000:2.0:1788638622.726089:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788638622.726194:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 539: rc = 0 00100000:10000000:2.0:1788638622.726619:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788638622.726696:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 462: rc = 0 00100000:10000000:2.0:1788638622.726941:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788638622.727011:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 462: rc = 0 00100000:10000000:2.0:1788638622.727191:0:14377:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788638622.727260:0:14377:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 462: rc = 0 00000020:00000080:2.0:1788638622.727522:0:14377:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788638622.727531:0:14377:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788638622.727542:0:14377:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa0b1f1e3b4b2b7f6 00000020:01000004:2.0:1788638622.727550:0:14377:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788638622.727554:0:14377:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788638622.727559:0:14377:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c73908d2000 from MGS 00000020:01000004:2.0:1788638622.727563:0:14377:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788638622.727576:0:14377:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9c7385320000) 00000020:00000080:2.0:1788638622.727587:0:14377:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788638622.727639:0:14377:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c73908d2000 from MGS, refs=2 00080000:01000000:2.0:1788638622.727644:0:14377:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788638622.727650:0:14377:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa0b1f1e3b4b2b804 00000100:00100000:2.0:1788638622.727743:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788638622.729053:0:14377:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788638622.729073:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788638622.733273:0:14377:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788638622.733285:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788638622.735958:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788638622.736857:0:14377:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788638622.736864:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788638622.737966:0:14377:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788638622.737976:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788638622.738336:0:14377:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788638622.738342:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1788638622.738958:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638622.738962:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638622.738963:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638622.739326:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638622.739328:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638622.739330:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638622.740087:0:14377:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788638622.744144:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788638622.758317:0:14377:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788638622.758333:0:14377:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788638622.758335:0:14377:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788638622.760265:0:14386:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788638622.760446:0:14377:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788638622.760537:0:14377:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788638622.761046:0:14377:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788638622.761350:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788638622.761491:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788638622.761498:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788638622.762439:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788638622.762449:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788638622.763746:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788638622.763756:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1788638622.765722:0:14390:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1788638622.766452:0:14377:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788638622.766486:0:14377:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.134@tcp' 00000020:01000004:3.0:1788638622.766488:0:14377:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788638622.767249:0:14377:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.134@tcp (typ=mgc) 00000020:00000080:3.0:1788638622.767265:0:14377:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.134@tcp (ffff9c7387d4b380) 00000020:00000080:3.0:1788638622.767284:0:14377:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788638622.767698:0:14377:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c738364a800@MGC192.168.203.134@tcp: add connection 192.168.203.134@tcp at head 00010000:00010000:3.0:1788638622.767902:0:14377:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.134@tcp-0 is initialized 00000040:01000000:3.0:1788638622.767909:0:14377:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.134@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788638622.771049:0:14391:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788638622.771132:0:14377:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.134@tcp (uuid d97ff07e-b3b5-4ef8-bed3-2a6960653930) 00000020:00000080:3.0:1788638622.771154:0:14377:0:(genops.c:1385:class_connect()) connect: client d97ff07e-b3b5-4ef8-bed3-2a6960653930, cookie 0xa0b1f1e3b4b2b812 00000100:00080000:3.0:1788638622.771167:0:14377:0:(import.c:545:import_select_connection()) MGC192.168.203.134@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788638622.771173:0:14377:0:(import.c:665:import_select_connection()) MGC192.168.203.134@tcp: import ffff9c738364a800 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:3.0:1788638622.772599:0:14377:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73b4664000 x1875523183663872/t0(0) o250->MGC192.168.203.134@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788638622.772697:0:14377:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d97ff07e-b3b5-4ef8-bed3-2a6960653930->MGS 00000020:01000004:3.0:1788638622.772732:0:14377:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788638622.772738:0:14377:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788638622.772753:0:14377:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9c7387d48000) 00000020:00000080:3.0:1788638622.772769:0:14377:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1788638622.773363:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3290:1875523183663872:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788638622.773430:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638622.773507:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183663872 00000100:00100000:0.0:1788638622.773515:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183663872 00000100:00100000:0.0:1788638622.773542:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788638622.773549:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bcddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3290:x1875523183663872:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1788638622.773571:0:14387:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from d97ff07e-b3b5-4ef8-bed3-2a6960653930@0@lo t0 exp 0000000000000000 cur 385 last 0 00000020:00000080:0.0:1788638622.773593:0:14387:0:(genops.c:1385:class_connect()) connect: client d97ff07e-b3b5-4ef8-bed3-2a6960653930, cookie 0xa0b1f1e3b4b2b820 00000100:00080000:0.0:1788638622.774464:0:14387:0:(import.c:65:import_set_state_nolock()) ffff9c73b7e9f800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788638622.774530:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bcddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+5:3290:x1875523183663872:12345-0@lo:250:mount.lustre.0 Request processed in 979us (1099us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638622.774538:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788638622.774590:0:3290:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.134@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1788638622.774599:0:3290:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.134@tcp: connect to target with instance 0 00000100:00080000:0.0:1788638622.774604:0:3290:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.134@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1788638622.776707:0:3290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1788638622.776719:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c738364a800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1788638622.776722:0:3290:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1788638622.776734:0:3290:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1788638622.776744:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3290:1875523183663872:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788638622.797158:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788638622.797411:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788638622.797416:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788638622.798736:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788638622.798744:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788638622.799510:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788638622.799517:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788638622.802436:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788638622.802706:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788638622.802713:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788638622.803996:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788638622.804004:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788638622.928641:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788638622.928857:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788638622.928863:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788638622.931238:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788638622.931250:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788638622.931878:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788638622.932307:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788638622.932313:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788638622.942746:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788638622.942886:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788638622.945905:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788638622.946113:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788638622.946119:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1788638622.946867:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788638622.946875:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1788638622.949292:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788638622.949721:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788638622.949728:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788638622.957105:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788638622.957124:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788638623.043835:0:14377:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788638623.044034:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788638623.044041:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788638623.045938:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788638623.045950:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1788638623.050530:0:14377:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788638623.054211:0:14377:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788638623.058126:0:14377:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788638623.058158:0:14377:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788638623.058175:0:14377:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.134@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788638623.058454:0:14377:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.134@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788638623.058853:0:14377:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.134@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788638623.058858:0:14377:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788638623.058859:0:14377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788638623.058861:0:14377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788638623.058862:0:14377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788638623.058863:0:14377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788638623.058865:0:14377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788638623.058866:0:14377:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788638623.058868:0:14377:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788638623.058869:0:14377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788638623.058870:0:14377:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788638623.058873:0:14377:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788638623.058875:0:14377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788638623.058877:0:14377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788638623.058878:0:14377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788638623.058879:0:14377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788638623.058880:0:14377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788638623.058881:0:14377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788638623.058882:0:14377:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788638623.058884:0:14377:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788638623.058885:0:14377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788638623.058886:0:14377:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788638623.058913:0:14377:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788638623.058934:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183664000:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788638623.059022:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638623.059081:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73887fdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788638623.059214:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183664000 00000100:00100000:1.0:1788638623.059221:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183664000 00000100:00100000:1.0:1788638623.059263:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788638623.059277:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bcdde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+5:14377:x1875523183664000:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788638623.059316:0:14389:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788638623.059319:0:14389:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788638623.059321:0:14389:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:0.0:1788638623.059774:0:14411:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788638623.060187:0:14389:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1788638623.065368:0:14412:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788638623.065377:0:14412:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788638623.065379:0:14412:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788638623.065437:0:14412:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788638623.065756:0:14389:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788638623.065766:0:14389:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788638623.082345:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bcdde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+5:14377:x1875523183664000:12345-0@lo:253:mount.lustre.0 Request processed in 23059us (23314us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638623.082364:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638623.082458:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183664000:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788638623.082474:0:14377:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788638623.082477:0:14377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788638623.082479:0:14377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788638623.082480:0:14377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788638623.082481:0:14377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788638623.082482:0:14377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788638623.082484:0:14377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788638623.082485:0:14377:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788638623.082487:0:14377:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788638623.082488:0:14377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788638623.082489:0:14377:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788638623.082510:0:14377:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c73908d2000 from lustre-MDT0000 10000000:01000000:0.0:1788638623.082535:0:14377:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788638623.082537:0:14377:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788638623.082541:0:14377:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9c7387d4b380 10000000:01000000:0.0:1788638623.082545:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788638623.082552:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9c7387d4b380 from 1 10000000:01000000:0.0:1788638623.082555:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788638623.082587:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638623.082598:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638623.082607:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638623.082639:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183664128:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788638623.082674:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638623.082714:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73887fdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788638623.082778:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183664128 00000100:00100000:2.0:1788638623.082822:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183664128 00000100:00100000:2.0:1788638623.082861:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788638623.082870:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bcddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+5:14377:x1875523183664128:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788638623.082881:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638623.082895:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b82e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2b827 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638623.082928:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b82e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b827 expref: 6 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638623.082939:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7399aa6a00/0xa0b1f1e3b4b2b82e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b827 expref: 6 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638623.082948:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6a00, rc 0) 00000100:00100000:2.0:1788638623.082993:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bcddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+6:14377:x1875523183664128:12345-0@lo:101:mount.lustre.0 Request processed in 124us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638623.082998:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638623.083120:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183664128:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788638623.083136:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b827 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b82e expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.083144:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b827 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2b82e expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638623.083191:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4666a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183664256:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788638623.083218:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638623.083243:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738f6bd600 going to sleep for 11 seconds 00000100:00100000:2.0:1788638623.083350:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183664256 00000100:00100000:2.0:1788638623.083355:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183664256 00000100:00100000:2.0:1788638623.083383:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788638623.083390:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bcddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+6:14377:x1875523183664256:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788638623.084018:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bcddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+6:14377:x1875523183664256:12345-0@lo:501:mount.lustre.0 Request processed in 627us (798us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788638623.084026:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788638623.088032:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4666a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183664256:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788638623.089042:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788638623.090866:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b827 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b82e expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638623.090899:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b82e expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638623.090908:0:14377:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c73908d2000 10000000:01000000:3.0:1788638623.091063:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788638623.091070:0:14377:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9c73908d2000 10000000:01000000:3.0:1788638623.091082:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788638623.091086:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9c73908d2000 from 1 10000000:01000000:3.0:1788638623.091089:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788638623.091128:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380030800/0xa0b1f1e3b4b2b835 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.091137:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7380030800/0xa0b1f1e3b4b2b835 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.091147:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7380030800/0xa0b1f1e3b4b2b835 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638623.091171:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4664700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183664384:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788638623.091235:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638623.091284:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738f6bd600 going to sleep for 11 seconds 00000100:00100000:2.0:1788638623.091521:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183664384 00000100:00100000:2.0:1788638623.091530:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183664384 00000100:00100000:2.0:1788638623.091584:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788638623.091593:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bcddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+6:14377:x1875523183664384:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788638623.091606:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638623.091619:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7399aa6200/0xa0b1f1e3b4b2b83c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2b835 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638623.091641:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7399aa6200/0xa0b1f1e3b4b2b83c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b835 expref: 7 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638623.091652:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7399aa6200/0xa0b1f1e3b4b2b83c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b835 expref: 7 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638623.091661:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6200, rc 0) 00000100:00100000:2.0:1788638623.091710:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bcddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+7:14377:x1875523183664384:12345-0@lo:101:mount.lustre.0 Request processed in 118us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638623.091717:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788638623.091932:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4664700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183664384:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788638623.091948:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7380030800/0xa0b1f1e3b4b2b835 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b83c expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638623.091957:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7380030800/0xa0b1f1e3b4b2b835 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2b83c expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638623.091972:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788638623.093697:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380030800/0xa0b1f1e3b4b2b835 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b83c expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638623.093712:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7380030800/0xa0b1f1e3b4b2b835 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b83c expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638623.093721:0:14377:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788638623.093830:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788638623.093837:0:14377:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9c73908d2000 10000000:01000000:2.0:1788638623.093840:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788638623.093844:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788638623.093847:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788638623.093881:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b843 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638623.093901:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b843 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638623.093920:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b843 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638623.093943:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183664512:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788638623.094002:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638623.094044:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73c0a3c600 going to sleep for 11 seconds 00000100:00100000:3.0:1788638623.094159:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183664512 00000100:00100000:3.0:1788638623.094166:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183664512 00000100:00100000:3.0:1788638623.094212:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788638623.094221:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+7:14377:x1875523183664512:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788638623.094234:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638623.094246:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7380031000/0xa0b1f1e3b4b2b84a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2b843 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.094266:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7380031000/0xa0b1f1e3b4b2b84a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b843 expref: 8 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.094276:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7380031000/0xa0b1f1e3b4b2b84a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b843 expref: 8 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.094284:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031000, rc 0) 00000100:00100000:3.0:1788638623.094326:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+8:14377:x1875523183664512:12345-0@lo:101:mount.lustre.0 Request processed in 105us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638623.094333:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788638623.094637:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183664512:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788638623.094651:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b843 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b84a expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638623.094659:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b843 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2b84a expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638623.094722:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d05f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183664640:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788638623.094767:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638623.094869:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7390d7fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788638623.095477:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183664640 00000100:00100000:3.0:1788638623.095484:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183664640 00000100:00100000:3.0:1788638623.095572:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788638623.095580:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+8:14377:x1875523183664640:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788638623.096227:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+9:14377:x1875523183664640:12345-0@lo:501:mount.lustre.0 Request processed in 646us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638623.096234:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788638623.096315:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d05f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183664640:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788638623.096353:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d05f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183664768:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788638623.096395:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638623.107875:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183664768 00000100:00100000:0.0:1788638623.107892:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183664768 00000100:00100000:0.0:1788638623.108049:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788638623.108060:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+9:14377:x1875523183664768:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788638623.108167:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7390d7fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788638623.108528:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+9:14377:x1875523183664768:12345-0@lo:503:mount.lustre.0 Request processed in 469us (12131us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638623.108536:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788638623.108908:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d05f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183664768:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788638623.109365:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d05f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14413:1875523183664896:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788638623.109415:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638623.109447:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7390d7f240 going to sleep for 11 seconds 00000100:00100000:2.0:1788638623.109498:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183664896 00000100:00100000:2.0:1788638623.109503:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183664896 00000100:00100000:2.0:1788638623.109541:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788638623.109549:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+9:14413:x1875523183664896:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788638623.110013:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d05f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14413:1875523183664896:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788638623.110036:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788638623.110046:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638623.110048:0:14413:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788638623.110056:0:14413:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788638623.110059:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788638623.110072:0:14413:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9c73880a8000) 00000020:00000080:1.0:1788638623.110087:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788638623.110093:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788638623.110161:0:14413:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788638623.110167:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa0b1f1e3b4b2b858 00000020:00000080:1.0:1788638623.110365:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788638623.110370:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788638623.110374:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638623.110381:0:14413:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788638623.110385:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788638623.110389:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638623.110390:0:14413:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788638623.110393:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788638623.110400:0:14413:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9c73880ab380) 00000020:00000080:1.0:1788638623.110409:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788638623.110412:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788638623.110414:0:14413:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788638623.110417:0:14413:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788638623.110422:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788638623.110466:0:14413:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c73908d2000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788638623.110478:0:14413:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9c73880acd40) 00000020:00000080:1.0:1788638623.110486:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788638623.110546:0:14413:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788638623.110551:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa0b1f1e3b4b2b86d 00000020:00000080:1.0:1788638623.110640:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788638623.110647:0:14413:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788638623.110651:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa0b1f1e3b4b2b874 00080000:01000000:1.0:1788638623.110656:0:14413:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788638623.110659:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa0b1f1e3b4b2b87b 00000100:00100000:2.0:1788638623.111891:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+9:14413:x1875523183664896:12345-0@lo:502:llog_process_th.0 Request processed in 2338us (2471us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638623.111902:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788638623.269269:0:14413:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:0.0:1788638623.269699:0:14413:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1788638623.269938:0:14413:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1788638623.270404:0:14413:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9c73bce38000) 00000020:00000080:0.0:1788638623.270420:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1788638623.270475:0:14413:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788638623.270483:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa0b1f1e3b4b2b889 00000020:00000080:2.0:1788638623.271481:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788638623.280918:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa0b1f1e3b4b2b890 00000020:00000080:2.0:1788638623.281239:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788638623.281250:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788638623.281256:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638623.281259:0:14413:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788638623.281262:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788638623.281265:0:14413:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788638623.281266:0:14413:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788638623.281268:0:14413:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788638623.281270:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788638623.281272:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638623.281279:0:14413:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788638623.281283:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788638623.281288:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638623.281289:0:14413:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788638623.281294:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788638623.281325:0:14413:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788638623.281339:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788638623.281342:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638623.281344:0:14413:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788638623.281346:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788638623.281350:0:14413:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788638623.281354:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638623.281355:0:14413:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788638623.281430:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788638623.281436:0:14413:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.134@tcp to nid 0x20000c0a8cb86 (192.168.203.134@tcp) 00000020:01000000:2.0:1788638623.281462:0:14413:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788638623.281465:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788638623.281479:0:14413:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9c73853219c0) 00000020:00000080:2.0:1788638623.281491:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788638623.281496:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788638623.281554:0:14413:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788638623.281561:0:14413:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788638623.281566:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa0b1f1e3b4b2b89e 00010000:00080000:2.0:1788638623.281596:0:14413:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c73bce5f000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.134@tcp at head 00010000:00010000:2.0:1788638623.282225:0:14413:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788638623.282635:0:14413:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788638623.282676:0:14413:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788638623.284497:0:14413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788638623.284573:0:14413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1788638623.284639:0:14413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1788638623.289900:0:14417:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788638623.289919:0:14417:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788638623.290450:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788638623.290462:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788638623.290500:0:14413:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788638623.290517:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa0b1f1e3b4b2b8a5 00000100:00080000:2.0:1788638623.290527:0:14413:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788638623.290533:0:14413:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c73bce5f000 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:2.0:1788638623.290567:0:14413:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7385378a80 x1875523183665024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788638623.290633:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183665024:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788638623.290687:0:3290:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523183665024 offset 0 length 520: 4 00000100:00080000:2.0:1788638623.290747:0:14413:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788638623.290839:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788638623.290843:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638623.290845:0:14413:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788638623.290848:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788638623.290851:0:14413:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1788638623.290853:0:14413:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788638623.290854:0:14413:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788638623.290855:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788638623.290858:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638623.290860:0:14413:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788638623.290862:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788638623.290866:0:14413:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788638623.290869:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638623.290870:0:14413:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788638623.290873:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788638623.290876:0:14413:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.134@tcp to nid 0x20000c0a8cb86 (192.168.203.134@tcp) 00000020:01000000:2.0:1788638623.290897:0:14413:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788638623.290899:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788638623.290910:0:14413:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9c7385323380) 00000020:00000080:2.0:1788638623.290922:0:14413:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1788638623.290926:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788638623.290987:0:14413:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1788638623.290993:0:14413:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788638623.290999:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa0b1f1e3b4b2b8b3 00010000:00080000:2.0:1788638623.291035:0:14413:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c73bce59800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.134@tcp at head 00010000:00010000:2.0:1788638623.291229:0:14413:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1788638623.291397:0:14413:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788638623.291418:0:14413:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788638623.292003:0:14413:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788638623.292076:0:14413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788638623.292144:0:14413:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788638623.293216:0:14419:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788638623.293221:0:14419:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788638623.293718:0:14413:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788638623.293728:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788638623.293756:0:14413:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788638623.293774:0:14413:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa0b1f1e3b4b2b8ba 00000100:00080000:2.0:1788638623.293913:0:14413:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788638623.293919:0:14413:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c73bce59800 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:3.0:1788638623.294055:0:14413:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73b4666d80 x1875523183665152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788638623.294088:0:14413:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788638623.294106:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183665152:0@lo:8:llog_process_th.0 00000020:01000000:3.0:1788638623.294141:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638623.294146:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638623.294147:0:14413:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788638623.294151:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788638623.294154:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638623.294155:0:14413:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788638623.294157:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788638623.294159:0:14413:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788638623.294162:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638623.294164:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638623.294165:0:14413:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788638623.294167:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000400:00000100:0.0:1788638623.294167:0:3290:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523183665152 offset 0 length 520: 4 00000020:00000080:3.0:1788638623.294169:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638623.294170:0:14413:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788638623.294174:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788638623.294198:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4664380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14413:1875523183665280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788638623.294244:0:14413:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638623.294269:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73882adb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788638623.294273:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183665280 00000100:00100000:2.0:1788638623.294278:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183665280 00000100:00100000:2.0:1788638623.294487:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788638623.294497:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+9:14413:x1875523183665280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788638623.294699:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+9:14413:x1875523183665280:12345-0@lo:502:llog_process_th.0 Request processed in 203us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638623.294707:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788638623.297212:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4664380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14413:1875523183665280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788638623.297252:0:14413:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638623.297262:0:14413:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638623.297264:0:14413:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788638623.297268:0:14413:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788638623.297532:0:14377:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788638623.297555:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788638623.297576:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b843 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b84a expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638623.297587:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7400/0xa0b1f1e3b4b2b843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b84a expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638623.297594:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c73908d2000 from 1 10000000:01000000:2.0:1788638623.297596:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788638623.297639:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b8c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638623.297647:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b8c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638623.297656:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b8c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638623.297675:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183665408:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788638623.297736:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638623.297773:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398466cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638623.300271:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183665408 00000100:00100000:3.0:1788638623.300286:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183665408 00000100:00100000:3.0:1788638623.300435:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788638623.300448:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+9:14377:x1875523183665408:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788638623.300464:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638623.300484:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7380031a00/0xa0b1f1e3b4b2b8c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2b8c1 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.300511:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7380031a00/0xa0b1f1e3b4b2b8c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b8c1 expref: 10 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.300522:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7380031a00/0xa0b1f1e3b4b2b8c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b8c1 expref: 10 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.300531:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031a00, rc 0) 00000100:00100000:3.0:1788638623.300605:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+10:14377:x1875523183665408:12345-0@lo:101:mount.lustre.0 Request processed in 160us (2869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638623.300612:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788638623.300637:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183665408:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788638623.300655:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b8c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b8c8 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638623.300664:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b8c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2b8c8 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638623.301436:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183665536:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788638623.301489:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638623.301530:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398466cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638623.301585:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183665536 00000100:00100000:3.0:1788638623.301590:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183665536 00000100:00100000:3.0:1788638623.301671:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788638623.301681:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+10:14377:x1875523183665536:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788638623.301698:0:14389:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788638623.301712:0:14389:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788638623.301836:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+10:14377:x1875523183665536:12345-0@lo:256:mount.lustre.0 Request processed in 156us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638623.301844:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788638623.302011:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183665536:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788638623.302592:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788638623.302620:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b8c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b8c8 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638623.302631:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b8c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b8c8 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638623.302647:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c73908d2000 from 1 10000000:01000000:2.0:1788638623.302649:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788638623.302672:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2b8cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638623.302679:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2b8cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638623.302688:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2b8cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638623.302703:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183665664:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788638623.302739:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638623.303138:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398466cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638623.303168:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183665664 00000100:00100000:0.0:1788638623.303206:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183665664 00000100:00100000:0.0:1788638623.303266:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788638623.303275:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+10:14377:x1875523183665664:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788638623.303294:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638623.303311:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b8d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2b8cf expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638623.303331:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b8d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b8cf expref: 11 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638623.303342:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b8d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b8cf expref: 11 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638623.303350:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01da00, rc 0) 00000100:00100000:0.0:1788638623.303509:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+11:14377:x1875523183665664:12345-0@lo:101:mount.lustre.0 Request processed in 235us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638623.303516:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788638623.303584:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183665664:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788638623.303599:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2b8cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b8d6 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638623.303607:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2b8cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2b8d6 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638623.303659:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183665792:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788638623.303685:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638623.303735:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183665792 00000100:00100000:2.0:1788638623.303739:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398466cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638623.303740:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183665792 00000100:00100000:3.0:1788638623.303991:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788638623.304001:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+11:14377:x1875523183665792:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788638623.304473:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+11:14377:x1875523183665792:12345-0@lo:501:mount.lustre.0 Request processed in 473us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638623.304481:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788638623.305516:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183665792:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788638623.305564:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183665920:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788638623.305627:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638623.305666:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398466cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638623.305731:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183665920 00000100:00100000:0.0:1788638623.305738:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183665920 00000100:00100000:0.0:1788638623.305771:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788638623.305806:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+11:14377:x1875523183665920:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788638623.305982:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+11:14377:x1875523183665920:12345-0@lo:503:mount.lustre.0 Request processed in 203us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638623.305990:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788638623.306023:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183665920:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788638623.307113:0:14421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d05f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14421:1875523183666048:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788638623.307170:0:14421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638623.307239:0:14421:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73854e3900 going to sleep for 11 seconds 00000100:00100000:0.0:1788638623.307283:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183666048 00000100:00100000:0.0:1788638623.307289:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183666048 00000100:00100000:0.0:1788638623.307325:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788638623.307333:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+11:14421:x1875523183666048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788638623.307663:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+11:14421:x1875523183666048:12345-0@lo:502:llog_process_th.0 Request processed in 329us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638623.307680:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788638623.307907:0:14421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d05f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14421:1875523183666048:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788638623.307942:0:14421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788638623.307950:0:14421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638623.307953:0:14421:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788638623.307960:0:14421:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c73908d2000 00000020:00000080:1.0:1788638623.307963:0:14421:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788638623.307972:0:14421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788638623.307974:0:14421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638623.307976:0:14421:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788638623.307978:0:14421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788638623.307980:0:14421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638623.307982:0:14421:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788638623.307985:0:14421:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c73908d2000 00000020:00000080:1.0:1788638623.307987:0:14421:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788638623.308038:0:14421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788638623.308041:0:14421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638623.308043:0:14421:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788638623.308046:0:14421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788638623.308048:0:14421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638623.308050:0:14421:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788638623.308053:0:14421:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c73908d2000 00000020:00000080:1.0:1788638623.308055:0:14421:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788638623.308091:0:14421:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d05f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14421:1875523183666176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788638623.308127:0:14421:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638623.308164:0:14421:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73854e3900 going to sleep for 11 seconds 00000100:00100000:2.0:1788638623.308330:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183666176 00000100:00100000:2.0:1788638623.308339:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183666176 00000100:00100000:2.0:1788638623.308367:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788638623.308375:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+11:14421:x1875523183666176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788638623.308529:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+11:14421:x1875523183666176:12345-0@lo:502:llog_process_th.0 Request processed in 154us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638623.308536:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788638623.308575:0:14421:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d05f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14421:1875523183666176:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788638623.308595:0:14421:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788638623.308599:0:14421:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788638623.308601:0:14421:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788638623.308606:0:14421:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788638623.308656:0:14377:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788638623.308673:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788638623.308689:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2b8cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b8d6 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638623.308700:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2b8cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b8d6 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638623.308737:0:14377:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788638623.308740:0:14377:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c73908d2000 10000000:01000000:2.0:1788638623.308743:0:14377:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c73908d2000 10000000:01000000:2.0:1788638623.308746:0:14377:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788638623.308757:0:14377:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c73908d2000 from 1 10000000:01000000:2.0:1788638623.308771:0:14377:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788638623.308826:0:14377:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6800/0xa0b1f1e3b4b2b8dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638623.308835:0:14377:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6800/0xa0b1f1e3b4b2b8dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638623.308845:0:14377:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6800/0xa0b1f1e3b4b2b8dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638623.308860:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183666304:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788638623.308889:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638623.308923:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398466480 going to sleep for 11 seconds 00000100:00100000:1.0:1788638623.309145:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183666304 00000100:00100000:1.0:1788638623.309150:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183666304 00000100:00100000:1.0:1788638623.309184:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788638623.309192:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+11:14377:x1875523183666304:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788638623.309202:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638623.309214:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7385309600/0xa0b1f1e3b4b2b8e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2b8dd expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638623.309243:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7385309600/0xa0b1f1e3b4b2b8e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b8dd expref: 12 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638623.309253:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7385309600/0xa0b1f1e3b4b2b8e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b8dd expref: 12 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638623.309261:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385309600, rc 0) 00000100:00100000:1.0:1788638623.309290:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:14377:x1875523183666304:12345-0@lo:101:mount.lustre.0 Request processed in 99us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638623.309296:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788638623.310201:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183666304:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788638623.310218:0:14377:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6800/0xa0b1f1e3b4b2b8dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b8e4 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638623.310227:0:14377:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6800/0xa0b1f1e3b4b2b8dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2b8e4 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638623.310278:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183666432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788638623.310313:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638623.310345:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398466480 going to sleep for 11 seconds 00000100:00100000:0.0:1788638623.310449:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183666432 00000100:00100000:0.0:1788638623.310454:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183666432 00000100:00100000:0.0:1788638623.310491:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788638623.310499:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:14377:x1875523183666432:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788638623.310743:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:14377:x1875523183666432:12345-0@lo:501:mount.lustre.0 Request processed in 244us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638623.310751:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788638623.312180:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183666432:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788638623.312227:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183666560:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788638623.312281:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638623.312326:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398466480 going to sleep for 11 seconds 00000100:00100000:3.0:1788638623.312420:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183666560 00000100:00100000:3.0:1788638623.312427:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183666560 00000100:00100000:3.0:1788638623.312470:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788638623.312478:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:14377:x1875523183666560:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788638623.312642:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:14377:x1875523183666560:12345-0@lo:503:mount.lustre.0 Request processed in 164us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638623.312650:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788638623.314064:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183666560:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788638623.315367:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14423:1875523183666688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788638623.315445:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638623.317261:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398466000 going to sleep for 11 seconds 00000100:00100000:3.0:1788638623.327876:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183666688 00000100:00100000:3.0:1788638623.327890:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183666688 00000100:00100000:2.0:1788638623.328164:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788638623.328175:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:14423:x1875523183666688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788638623.333329:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:14423:x1875523183666688:12345-0@lo:502:llog_process_th.0 Request processed in 5146us (17874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638623.333345:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788638623.333419:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14423:1875523183666688:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788638623.333493:0:14423:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788638623.333509:0:14423:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9c7385324d40) 00000020:00000080:2.0:1788638623.333525:0:14423:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1788638623.333618:0:14423:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c73908d2000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788638623.333622:0:14423:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c73908d2000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788638623.333625:0:14423:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c73908d2000 4 00010000:00080000:2.0:1788638623.333655:0:14423:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c73bf66b000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.134@tcp at head 00010000:00010000:2.0:1788638623.340257:0:14423:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788638623.340457:0:14423:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788638623.340492:0:14423:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788638623.340506:0:14423:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa0b1f1e3b4b2b8f2 00000100:00080000:2.0:1788638623.340517:0:14423:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788638623.340523:0:14423:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c73bf66b000 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:2.0:1788638623.340558:0:14423:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c7385379f80 x1875523183666816/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788638623.340594:0:14423:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788638623.350229:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875523183666816:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788638623.350298:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638623.351210:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183666816 00000100:00100000:0.0:1788638623.351222:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183666816 00000100:00100000:0.0:1788638623.351257:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788638623.351265:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1875523183666816:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788638623.351336:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1875523183666816:12345-0@lo:38:llog_process_th.0 Request processed in 71us (1037us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788638623.351343:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638623.355019:0:3290:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788638623.355031:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73bf66b000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788638623.355038:0:3290:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788638623.355042:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875523183666816:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788638623.355365:0:14423:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14423:1875523183666944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788638623.355434:0:14423:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638623.355474:0:14423:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398466a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788638623.355721:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183666944 00000100:00100000:3.0:1788638623.355727:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183666944 00000100:00100000:3.0:1788638623.356010:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788638623.356020:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:14423:x1875523183666944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788638623.356374:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:14423:x1875523183666944:12345-0@lo:502:llog_process_th.0 Request processed in 355us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638623.356382:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788638623.356481:0:14423:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14423:1875523183666944:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788638623.356509:0:14423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788638623.356686:0:14377:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788638623.356705:0:14377:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788638623.356725:0:14377:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6800/0xa0b1f1e3b4b2b8dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b8e4 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.356735:0:14377:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6800/0xa0b1f1e3b4b2b8dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b8e4 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788638623.356818:0:14377:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788638623.356821:0:14377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788638623.356822:0:14377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788638623.356823:0:14377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788638623.356825:0:14377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788638623.356826:0:14377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788638623.356828:0:14377:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788638623.356829:0:14377:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788638623.356831:0:14377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788638623.356833:0:14377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788638623.356837:0:14377:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788638623.356839:0:14377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788638623.356841:0:14377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788638623.356842:0:14377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788638623.356843:0:14377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788638623.356844:0:14377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788638623.356845:0:14377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788638623.356847:0:14377:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788638623.356848:0:14377:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788638623.356849:0:14377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788638623.356850:0:14377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788638623.356866:0:14377:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788638623.356878:0:14377:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4664380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183667072:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788638623.356933:0:14377:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638623.356969:0:14377:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387219b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788638623.358163:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183667072 00000100:00100000:1.0:1788638623.358174:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183667072 00000100:00100000:1.0:1788638623.358337:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788638623.358347:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:14377:x1875523183667072:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788638623.358388:0:14387:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788638623.358402:0:14387:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788638623.419074:0:14387:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788638623.419095:0:14387:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:1.0:1788638623.419224:0:14411:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788638623.419230:0:14411:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788638623.419255:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2b8f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638623.419275:0:14411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7380031a00/0xa0b1f1e3b4b2b8c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b8c1 expref: 12 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638623.419284:0:14411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2b8f9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638623.419321:0:14411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7380031a00/0xa0b1f1e3b4b2b8c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b8c1 expref: 12 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638623.419351:0:14411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7380031a00/0xa0b1f1e3b4b2b8c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b8c1 expref: 12 pid: 14388 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638623.419366:0:14411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d04e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14411:1875523183667200:0@lo:104: 00000100:00100000:1.0:1788638623.419430:0:14411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638623.419467:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183667200 00000100:00100000:1.0:1788638623.419467:0:14411:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398581b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788638623.419475:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183667200 00000100:00100000:3.0:1788638623.419521:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638623.419531:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7d05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+3:14411:x1875523183667200:12345-0@lo:104: 00010000:00010000:3.0:1788638623.419543:0:14378:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b8c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2b8c8 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.419600:0:14378:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788638623.419606:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7d05880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+3:14411:x1875523183667200:12345-0@lo:104: Request processed in 78us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638623.419613:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788638623.419631:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638623.419637:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b8c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2b8c8 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.419643:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6000 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:3.0:1788638623.419647:0:14384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b8c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2b8c8 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.419656:0:14384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b8c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2b8c8 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788638623.419663:0:14384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b8c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2b8c8 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638623.419669:0:14384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788638623.419703:0:14384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b8c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2b8c8 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.419711:0:14384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788638623.419727:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b8c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2b8c8 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638623.419731:0:14411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d04e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14411:1875523183667200:0@lo:104: 00010000:00010000:3.0:1788638623.419734:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7399aa6000/0xa0b1f1e3b4b2b8c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2b8c8 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.419748:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638623.419748:0:14411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2b8f9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.419750:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638623.419752:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638623.419826:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3294:1875523183667328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788638623.419857:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638623.419914:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183667328 00000100:00100000:3.0:1788638623.419919:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183667328 00010000:00010000:3.0:1788638623.419937:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7380031a00/0xa0b1f1e3b4b2b8c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b8c1 expref: 13 pid: 14388 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638623.419965:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638623.419971:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4665c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+13:3294:x1875523183667328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788638623.419981:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638623.419985:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7380031a00/0xa0b1f1e3b4b2b8c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b8c1 expref: 13 pid: 14388 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.419994:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7380031a00/0xa0b1f1e3b4b2b8c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b8c1 expref: 13 pid: 14388 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.420006:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7380031a00/0xa0b1f1e3b4b2b8c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b8c1 expref: 13 pid: 14388 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.420024:0:14380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2b8f9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.420031:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2b8f9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788638623.420043:0:14380:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000814248s 00010000:00010000:3.0:1788638623.420047:0:14380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2b8f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.420053:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2b8f9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.420060:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2b8f9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.420066:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2b8f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.420071:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309400 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638623.420075:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2b8f9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.420081:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2b8f9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.420095:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2b8f9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.420103:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638623.420148:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4665c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:3294:x1875523183667328:12345-0@lo:103:ldlm_bl.0 Request processed in 177us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638623.420155:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638623.420179:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3294:1875523183667328:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788638623.420195:0:14411:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2b8f9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.420201:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2b8f9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638623.420208:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7385309400/0xa0b1f1e3b4b2b8f9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638623.452081:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+11:14377:x1875523183667072:12345-0@lo:253:mount.lustre.0 Request processed in 93725us (95136us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638623.452097:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788638623.453086:0:14377:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4664380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14377:1875523183667072:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788638623.453104:0:14377:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788638623.453107:0:14377:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788638623.453109:0:14377:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788638623.453110:0:14377:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788638623.453111:0:14377:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788638623.453112:0:14377:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788638623.453113:0:14377:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788638623.453115:0:14377:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788638623.453116:0:14377:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788638623.453118:0:14377:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788638623.453119:0:14377:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788638623.453138:0:14377:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788638623.459592:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1788638623.459954:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788638623.460247:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1788638623.460421:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788638623.460671:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1788638623.465238:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788638623.481624:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788638623.481839:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788638623.482260:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788638623.482507:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788638623.483044:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788638623.483207:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788638623.531684:0:14377:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788638623.533451:0:14377:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1788638623.533688:0:14433:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1788638623.533693:0:14433:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788638623.536262:0:14434:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788638623.536382:0:14434:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788638623.540358:0:14434:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788638623.540449:0:14434:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788638623.540453:0:14434:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1788638623.543576:0:14377:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788638623.543705:0:14377:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788638623.545507:0:14377:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788638623.545653:0:14377:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788638623.545923:0:14377:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788638623.546925:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788638623.547434:0:14377:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788638623.547462:0:14377:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1788638623.548641:0:14377:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1788638623.568130:0:14377:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788638623.600135:0:14377:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788638623.600181:0:14377:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbd4881c5f988 00100000:10000000:2.0:1788638623.600188:0:14377:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788638623.601376:0:14377:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788638623.601392:0:14377:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.134@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788638623.601405:0:14377:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1788638623.601430:0:14377:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788638623.787011:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788638624.416526:0:14429:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:2.0:1788638624.480411:0:14391:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788638624.480419:0:14391:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c73908d2000 from 6 10000000:01000000:2.0:1788638624.480424:0:14391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788638624.480475:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b900 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638624.480488:0:14391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b900 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638624.480499:0:14391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b900 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638624.480524:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183667456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788638624.480929:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638624.481169:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183667456 00000100:00100000:3.0:1788638624.481177:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183667456 00000100:00100000:3.0:1788638624.481226:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788638624.481235:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+11:14391:x1875523183667456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788638624.481249:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638624.481262:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2b907 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2b900 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638624.481299:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2b907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b900 expref: 12 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638624.481311:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2b907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b900 expref: 12 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638624.481320:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031e00, rc 0) 00000100:00100000:3.0:1788638624.481362:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:14391:x1875523183667456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638624.481369:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788638624.481432:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73987240c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788638624.481470:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183667456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788638624.481486:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b900 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b907 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638624.481496:0:14391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b900 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2b907 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638624.481553:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183667584:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788638624.482132:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638624.482162:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73987240c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638624.482297:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183667584 00000100:00100000:3.0:1788638624.482302:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183667584 00000100:00100000:3.0:1788638624.482340:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788638624.482349:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:14391:x1875523183667584:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788638624.482365:0:14387:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788638624.482380:0:14387:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788638624.482383:0:14387:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788638624.483089:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:14391:x1875523183667584:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 737us (952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638624.483098:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788638624.483164:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183667584:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788638624.483212:0:14391:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788638624.483221:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b900 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b907 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638624.483230:0:14391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b900 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b907 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638624.800125:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788638625.448705:0:14429:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788638625.824024:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638626.848437:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638627.871998:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788638628.303486:0:14676:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg334-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788638628.584526:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788638628.584533:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788638628.584535:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788638628.584547:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788638628.584550:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788638628.584553:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788638628.584558:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c73bf66b000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788638628.584570:0:37:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9c73bf66b000 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:1.0:1788638628.584607:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73b7d06d80 x1875523183667840/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788638628.584672:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183667712:0@lo:400:kworker.0 00000100:00100000:1.0:1788638628.584811:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638628.584900:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183667712 00000100:00100000:1.0:1788638628.584907:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183667712 00000100:00100000:1.0:1788638628.584948:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788638628.584956:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:3291:x1875523183667712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638628.585003:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:3291:x1875523183667712:12345-0@lo:400:kworker.0 Request processed in 47us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638628.585010:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788638628.585068:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183667712:0@lo:400:kworker.0 00000100:00100000:3.0:1788638628.585267:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875523183667840:0@lo:38:kworker.0 00000100:00100000:3.0:1788638628.585301:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638628.587205:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183667840 00000100:00100000:0.0:1788638628.587222:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183667840 00000100:00100000:0.0:1788638628.587278:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638628.587285:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3290:x1875523183667840:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788638628.587315:0:14397:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 391 last 0 00000020:00000080:0.0:1788638628.587350:0:14397:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa0b1f1e3b4b2b90e 00000004:00100000:0.0:1788638628.587366:0:14397:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788638628.587492:0:14397:0:(import.c:65:import_set_state_nolock()) ffff9c7398782000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788638628.587617:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3290:x1875523183667840:12345-0@lo:38:kworker.0 Request processed in 330us (2314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638628.587624:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788638628.596302:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c73b7d06d80 x1875523183667840/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788638638 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788638628.596327:0:3290:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788638628.596336:0:3290:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788638628.596341:0:3290:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788638628.596345:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73bf66b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788638628.596353:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3290:1875523183667840:0@lo:38:kworker.0 00010000:00010000:3.0:1788638628.899958:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638629.920028:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638630.944300:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788638631.379586:0:14827:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8279be80 20000000:00000080:2.0:1788638631.379603:0:14827:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c73ae0f8800 uarg=0000000000000000 20000000:01000000:2.0:1788638631.379639:0:14827:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788638631.379646:0:14827:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788638631.379650:0:14827:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1788638631.380972:0:14828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788638631.381111:0:14827:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788638631.385917:0:14827:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788638631.385949:0:14827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b915 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638631.385968:0:14827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b8d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b8cf expref: 11 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638631.385978:0:14827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b915 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638631.386021:0:14827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b8d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b8cf expref: 11 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638631.386038:0:14827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b8d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b8cf expref: 11 pid: 14387 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638631.386052:0:14827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14827:1875523183667968:0@lo:104: 00000100:00100000:2.0:1788638631.386116:0:14827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638631.386168:0:14827:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398237f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788638631.387536:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183667968 00000100:00100000:3.0:1788638631.387547:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183667968 00000100:00100000:3.0:1788638631.387611:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788638631.387622:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+3:14827:x1875523183667968:12345-0@lo:104: 00010000:00010000:3.0:1788638631.387637:0:14378:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2b8cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2b8d6 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638631.387723:0:14378:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788638631.387741:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+3:14827:x1875523183667968:12345-0@lo:104: Request processed in 122us (1624us total) trans 0 rc 0/0 00010000:00010000:1.0:1788638631.387746:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788638631.387749:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788638631.387756:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2b8cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2b8d6 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638631.387766:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7e00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:1.0:1788638631.387816:0:14383:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2b8cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2b8d6 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638631.387841:0:14383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2b8cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2b8d6 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788638631.387848:0:14383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2b8cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2b8d6 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638631.387854:0:14383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788638631.387893:0:14383:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2b8cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2b8d6 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638631.387900:0:14383:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788638631.387925:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2b8cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2b8d6 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638631.387931:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2b8cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2b8d6 expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638631.387950:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638631.387952:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638631.387954:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638631.388065:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3292:1875523183668096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788638631.388104:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638631.388163:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183668096 00000100:00100000:3.0:1788638631.388168:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183668096 00010000:00010000:3.0:1788638631.388188:0:14381:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b8d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b8cf expref: 12 pid: 14387 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638631.388229:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788638631.388237:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:3292:x1875523183668096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788638631.388248:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638631.388256:0:14381:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b8d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b8cf expref: 12 pid: 14387 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638631.388269:0:14381:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b8d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b8cf expref: 12 pid: 14387 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638631.388288:0:14381:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b915 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638631.388297:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b915 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638631.388314:0:14381:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b915 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638631.388322:0:14381:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b915 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638631.388326:0:14827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b8d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b8cf expref: 12 pid: 14387 timeout: 494 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638631.388333:0:14381:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b915 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638631.388340:0:14381:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b915 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638631.388358:0:14381:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7c00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638631.388363:0:14381:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b915 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638631.388364:0:14827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14827:1875523183667968:0@lo:104: 00010000:00010000:3.0:1788638631.388381:0:14381:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b915 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638631.388385:0:14827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b915 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638631.388392:0:14381:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b915 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638631.388396:0:14827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b915 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638631.388406:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788638631.388406:0:14827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b915 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638631.388415:0:14827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b915 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638631.388442:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+11:3292:x1875523183668096:12345-0@lo:103:ldlm_bl.0 Request processed in 205us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638631.388452:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638631.388531:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3292:1875523183668096:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788638631.968550:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638632.993248:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788638633.312982:0:14391:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788638633.312989:0:14391:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c73908d2000 from 10 10000000:01000000:3.0:1788638633.312994:0:14391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788638633.313039:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031a00/0xa0b1f1e3b4b2b91c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638633.313049:0:14391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7380031a00/0xa0b1f1e3b4b2b91c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638633.313060:0:14391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7380031a00/0xa0b1f1e3b4b2b91c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638633.313085:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4665180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183668224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788638633.313148:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638633.313196:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788638633.313328:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183668224 00000100:00100000:0.0:1788638633.313347:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183668224 00000100:00100000:0.0:1788638633.313394:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788638633.313403:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+11:14391:x1875523183668224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788638633.313415:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638633.313429:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b923 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2b91c expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638633.313453:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b923 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b91c expref: 12 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638633.313464:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b923 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b91c expref: 12 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638633.313486:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01ce00, rc 0) 00000100:00100000:0.0:1788638633.313536:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:14391:x1875523183668224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638633.313544:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788638633.313965:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4665180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183668224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788638633.313982:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7380031a00/0xa0b1f1e3b4b2b91c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b923 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638633.313999:0:14391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7380031a00/0xa0b1f1e3b4b2b91c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2b923 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638633.314055:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4665180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183668352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788638633.314084:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638633.314188:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c728304af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788638633.314523:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183668352 00000100:00100000:1.0:1788638633.314529:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183668352 00000100:00100000:1.0:1788638633.314566:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788638633.314574:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:14391:x1875523183668352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788638633.314861:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:14391:x1875523183668352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 286us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638633.314869:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788638633.314973:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4665180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183668352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788638633.315008:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183668480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788638633.315045:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638633.315058:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7382b4bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788638633.315100:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183668480 00000100:00100000:1.0:1788638633.315105:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183668480 00000100:00100000:1.0:1788638633.315204:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788638633.315212:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:14391:x1875523183668480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788638633.315342:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:14391:x1875523183668480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638633.315349:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788638633.315853:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183668480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788638633.316515:0:14906:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788638633.316560:0:14391:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788638633.316580:0:14391:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788638633.316589:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031a00/0xa0b1f1e3b4b2b91c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b923 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638633.316598:0:14391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7380031a00/0xa0b1f1e3b4b2b91c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b923 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638633.695898:0:3290:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788638623/real 1788638623] req@ffff9c73b4666d80 x1875523183665152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788638633 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638633.695926:0:3290:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c73b4666d80 x1875523183665152/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788638633 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638633.695936:0:3290:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788638623/real 1788638623] req@ffff9c7385378a80 x1875523183665024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788638633 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788638633.695947:0:3290:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c7385378a80 x1875523183665024/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788638633 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788638633.695964:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73bce59800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788638633.695971:0:3290:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788638633.695975:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183665152:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788638633.695980:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73bce5f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788638633.695985:0:3290:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788638633.695987:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183665024:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788638633.696156:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788638633.696161:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788638633.696165:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c73bce5f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788638633.696169:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 386 00000100:00080000:3.0:1788638633.696175:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788638633.696181:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c73bce5f000 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:3.0:1788638633.696212:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73b4666680 x1875523183668608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788638633.696230:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788638633.696239:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788638633.696241:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c73bce59800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788638633.696245:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 386 00000100:00080000:3.0:1788638633.696247:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788638633.696251:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c73bce59800 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:3.0:1788638633.696264:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73b4667480 x1875523183668736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788638633.696305:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183668864:0@lo:400:kworker.0 00000100:00100000:3.0:1788638633.696362:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638633.696433:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183668864 00000100:00100000:3.0:1788638633.696440:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183668864 00000100:00100000:3.0:1788638633.696479:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638633.696486:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183668864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638633.696531:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183668864:12345-0@lo:400:kworker.0 Request processed in 45us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638633.696538:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788638633.696595:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c73b4666d80 x1875523183668864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638649 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638633.696606:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183668864:0@lo:400:kworker.0 00000100:00100000:3.0:1788638633.696623:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183668608:0@lo:8:kworker.0 00000400:00000100:3.0:1788638633.696657:0:3290:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523183668608 offset 0 length 520: 4 00000100:00100000:3.0:1788638633.696676:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183668736:0@lo:8:kworker.0 00000400:00000100:3.0:1788638633.696692:0:3290:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875523183668736 offset 0 length 520: 4 00010000:00010000:3.0:1788638634.016646:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638635.039955:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788638635.682849:0:14429:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788638636.065260:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788638636.337159:0:15075:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788638636.337163:0:15075:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788638636.337277:0:15075:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c73b4524000 00000020:01000004:3.0:1788638636.337291:0:15075:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788638636.337302:0:15075:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788638636.337315:0:15075:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9c7387d4cd40) 00000020:00000080:3.0:1788638636.337331:0:15075:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788638636.353998:0:15075:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788638636.354279:0:15075:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788638636.355090:0:15075:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788638636.355333:0:15075:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788638636.355554:0:15075:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788638636.355956:0:15075:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 545: rc = 0 00100000:10000000:3.0:1788638636.356054:0:15075:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 545: rc = 0 00100000:10000000:3.0:1788638636.356147:0:15075:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 545: rc = 0 00100000:10000000:3.0:1788638636.356537:0:15075:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 674: rc = 0 00100000:10000000:2.0:1788638636.358615:0:15075:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 674: rc = 0 00100000:10000000:2.0:1788638636.358937:0:15075:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 674: rc = 0 00100000:10000000:2.0:1788638636.359189:0:15075:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 674: rc = 0 00100000:10000000:2.0:1788638636.359430:0:15075:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 674: rc = 0 00100000:10000000:2.0:1788638636.359710:0:15075:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 674: rc = 0 00000020:00000080:2.0:1788638636.360334:0:15075:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788638636.360345:0:15075:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788638636.360356:0:15075:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa0b1f1e3b4b2b931 00000020:01000004:2.0:1788638636.360364:0:15075:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788638636.360386:0:15075:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.134@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788638636.360396:0:15075:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788638636.360402:0:15075:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788638636.360407:0:15075:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788638636.360426:0:15075:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9c73ae390000) 00000020:00000080:2.0:1788638636.360437:0:15075:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788638636.361525:0:15075:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788638636.361686:0:15075:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788638636.369733:0:15075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788638636.371242:0:15075:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788638636.371254:0:15075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1788638636.373082:0:15075:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1788638636.373096:0:15075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788638636.378065:0:15075:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788638636.378248:0:15075:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788638636.378254:0:15075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788638636.378986:0:15075:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788638636.378995:0:15075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788638636.401561:0:15075:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788638636.402012:0:15075:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788638636.402019:0:15075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788638636.404765:0:15075:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788638636.404777:0:15075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788638636.405953:0:15075:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788638636.405964:0:15075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788638636.408385:0:15075:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788638636.408571:0:15075:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788638636.408577:0:15075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788638636.409223:0:15075:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788638636.409230:0:15075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788638636.452359:0:15075:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788638636.452544:0:15075:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788638636.452551:0:15075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1788638636.455299:0:15075:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1788638636.455323:0:15075:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788638636.463086:0:15075:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788638636.463122:0:15075:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1788638636.463128:0:15075:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.134@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788638636.496947:0:15075:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.134@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788638636.496995:0:15075:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.134@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1788638636.497000:0:15075:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788638636.497002:0:15075:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788638636.497003:0:15075:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638636.497005:0:15075:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638636.497006:0:15075:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638636.497008:0:15075:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638636.497009:0:15075:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788638636.497011:0:15075:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638636.497012:0:15075:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788638636.497016:0:15075:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1788638636.497018:0:15075:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788638636.497019:0:15075:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788638636.497020:0:15075:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638636.497021:0:15075:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638636.497022:0:15075:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638636.497024:0:15075:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638636.497025:0:15075:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788638636.497026:0:15075:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638636.497027:0:15075:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788638636.497053:0:15075:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788638636.497072:0:15075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183668992:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788638636.497140:0:15075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638636.497205:0:15075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398edc840 going to sleep for 11 seconds 00000100:00100000:3.0:1788638636.497656:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183668992 00000100:00100000:3.0:1788638636.497664:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183668992 00000100:00100000:3.0:1788638636.497720:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788638636.497729:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73a63cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:15075:x1875523183668992:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788638636.497770:0:14387:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788638636.497779:0:14387:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788638636.497811:0:14387:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1788638636.513527:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73a63cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:15075:x1875523183668992:12345-0@lo:253:mount.lustre.0 Request processed in 15791us (16378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638636.513542:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788638636.513738:0:15075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d05500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183668992:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788638636.513754:0:15075:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788638636.513757:0:15075:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788638636.513759:0:15075:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788638636.513760:0:15075:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788638636.513761:0:15075:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788638636.513762:0:15075:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788638636.513764:0:15075:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788638636.513765:0:15075:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788638636.513766:0:15075:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788638636.513767:0:15075:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788638636.513911:0:15075:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c73b4524000 from lustre-OST0000 10000000:01000000:3.0:1788638636.513937:0:15075:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788638636.513940:0:15075:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788638636.513947:0:15075:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c7387d4b380 local copy 00010000:00010000:3.0:1788638636.513957:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b827 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b82e expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638636.514164:0:15075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4666d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183669120:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788638636.514202:0:15075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638636.514277:0:15075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7386665840 going to sleep for 11 seconds 00000100:00100000:1.0:1788638636.514548:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183669120 00000100:00100000:1.0:1788638636.514554:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183669120 00000100:00100000:3.0:1788638636.514759:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788638636.514768:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73a63cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:15075:x1875523183669120:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788638636.514997:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73a63cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:15075:x1875523183669120:12345-0@lo:501:mount.lustre.0 Request processed in 230us (794us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788638636.515005:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788638636.515140:0:15075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4666d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183669120:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788638636.515156:0:15075:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788638636.515426:0:15075:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788638636.515434:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b827 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b82e expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638636.515444:0:15075:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b82e expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638636.515473:0:15075:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c73b4524000 10000000:01000000:1.0:1788638636.515478:0:15075:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788638636.515483:0:15075:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9c7387d4b380 10000000:01000000:1.0:1788638636.515485:0:15075:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1788638636.515488:0:15075:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9c7387d4b380 from 1 10000000:01000000:1.0:1788638636.515491:0:15075:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1788638636.515517:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385309000/0xa0b1f1e3b4b2b93f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638636.515525:0:15075:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7385309000/0xa0b1f1e3b4b2b93f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638636.515535:0:15075:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7385309000/0xa0b1f1e3b4b2b93f lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638636.515550:0:15075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d07100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183669248:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788638636.515582:0:15075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638636.515614:0:15075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387973600 going to sleep for 11 seconds 00000100:00100000:2.0:1788638636.515749:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183669248 00000100:00100000:2.0:1788638636.515760:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183669248 00000100:00100000:2.0:1788638636.515897:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788638636.515907:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf62a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+12:15075:x1875523183669248:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788638636.515917:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638636.515930:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7399aa7800/0xa0b1f1e3b4b2b946 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2b93f expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638636.515952:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7399aa7800/0xa0b1f1e3b4b2b946 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b93f expref: 13 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638636.515963:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7399aa7800/0xa0b1f1e3b4b2b946 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b93f expref: 13 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638636.515972:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7800, rc 0) 00000100:00100000:2.0:1788638636.516012:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf62a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+13:15075:x1875523183669248:12345-0@lo:101:mount.lustre.0 Request processed in 107us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638636.516019:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788638636.516186:0:15075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d07100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183669248:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788638636.516203:0:15075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7385309000/0xa0b1f1e3b4b2b93f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b946 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638636.516211:0:15075:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7385309000/0xa0b1f1e3b4b2b93f lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2b946 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638636.516227:0:15075:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1788638636.516242:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385309000/0xa0b1f1e3b4b2b93f lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b946 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638636.516261:0:15075:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7385309000/0xa0b1f1e3b4b2b93f lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b946 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638636.516267:0:15075:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788638636.516271:0:15075:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788638636.516275:0:15075:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788638636.516277:0:15075:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788638636.516291:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385309a00/0xa0b1f1e3b4b2b94d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638636.516297:0:15075:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7385309a00/0xa0b1f1e3b4b2b94d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638636.516304:0:15075:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7385309a00/0xa0b1f1e3b4b2b94d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638636.516318:0:15075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d07100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183669376:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788638636.516344:0:15075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638636.516371:0:15075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387973600 going to sleep for 11 seconds 00000100:00100000:2.0:1788638636.516425:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183669376 00000100:00100000:2.0:1788638636.516430:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183669376 00000100:00100000:2.0:1788638636.516461:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788638636.516468:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+13:15075:x1875523183669376:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788638636.516475:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638636.516483:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b954 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2b94d expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638636.516496:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b94d expref: 14 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638636.516503:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7399aa6e00/0xa0b1f1e3b4b2b954 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b94d expref: 14 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638636.516515:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6e00, rc 0) 00000100:00100000:2.0:1788638636.516543:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+14:15075:x1875523183669376:12345-0@lo:101:mount.lustre.0 Request processed in 75us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638636.516549:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788638636.516741:0:15075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d07100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183669376:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788638636.516752:0:15075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7385309a00/0xa0b1f1e3b4b2b94d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b954 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638636.516760:0:15075:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7385309a00/0xa0b1f1e3b4b2b94d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2b954 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788638636.517428:0:15075:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788638636.526166:0:15075:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788638636.526460:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788638636.526508:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788638636.526542:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788638636.526592:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788638636.526635:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788638636.526757:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788638636.526920:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788638636.526930:0:15075:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788638636.527012:0:15075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d07100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183669504:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788638636.527075:0:15075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638636.527125:0:15075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387973300 going to sleep for 11 seconds 00000100:00100000:3.0:1788638636.528229:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183669504 00000100:00100000:3.0:1788638636.528241:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183669504 00000100:00100000:3.0:1788638636.528294:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788638636.528315:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf62b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+14:15075:x1875523183669504:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788638636.528853:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf62b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+14:15075:x1875523183669504:12345-0@lo:501:mount.lustre.0 Request processed in 539us (1777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638636.528862:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788638636.531604:0:15075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d07100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183669504:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788638636.531983:0:15075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183669632:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788638636.544907:0:15075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638636.544948:0:15075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bf2ad540 going to sleep for 11 seconds 00000100:00100000:3.0:1788638636.545040:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183669632 00000100:00100000:3.0:1788638636.545049:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183669632 00000100:00100000:3.0:1788638636.545105:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788638636.545114:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf62b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+14:15075:x1875523183669632:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788638636.545468:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf62b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+14:15075:x1875523183669632:12345-0@lo:503:mount.lustre.0 Request processed in 354us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638636.545476:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788638636.545586:0:15075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183669632:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788638636.547473:0:15075:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788638636.547569:0:15075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183669760:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788638636.547635:0:15075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638636.547951:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183669760 00000100:00100000:3.0:1788638636.547958:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183669760 00000100:00100000:3.0:1788638636.548002:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788638636.548011:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf62a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+14:15075:x1875523183669760:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788638636.548218:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf62a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+14:15075:x1875523183669760:12345-0@lo:502:mount.lustre.0 Request processed in 207us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638636.548226:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788638636.548994:0:15075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bf2ad540 going to sleep for 11 seconds 00000100:00100000:3.0:1788638636.549019:0:15075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183669760:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788638636.549296:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788638636.549357:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788638636.549395:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788638636.549448:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788638636.549486:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788638636.549520:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788638636.549569:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788638636.549617:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788638636.550519:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:3.0:1788638636.550603:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:3.0:1788638636.550644:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:3.0:1788638636.550724:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:3.0:1788638636.550802:0:15075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4664380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183669888:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788638636.550880:0:15075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638636.550926:0:15075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73981c4240 going to sleep for 11 seconds 00000100:00100000:0.0:1788638636.551089:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183669888 00000100:00100000:0.0:1788638636.551096:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183669888 00000100:00100000:0.0:1788638636.551150:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788638636.551158:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+14:15075:x1875523183669888:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788638636.551371:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+14:15075:x1875523183669888:12345-0@lo:502:mount.lustre.0 Request processed in 213us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638636.551379:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788638636.551466:0:15075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4664380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183669888:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788638636.551536:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788638636.551546:0:15075:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788638636.552575:0:15089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788638636.552583:0:15089:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788638636.552590:0:15089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638636.552592:0:15089:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788638636.552597:0:15089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788638636.552612:0:15089:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9c73880a99c0) 00000020:00000080:1.0:1788638636.552632:0:15089:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788638636.552637:0:15089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788638636.552714:0:15089:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c73b4524000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788638636.552721:0:15089:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788638636.552730:0:15089:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa0b1f1e3b4b2b962 00010000:00010000:1.0:1788638636.556184:0:15089:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788638636.556627:0:15089:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1788638636.559269:0:15089:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788638636.560598:0:15089:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788638636.560610:0:15089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788638636.560624:0:15089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638636.560626:0:15089:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788638636.560630:0:15089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788638636.560632:0:15089:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1788638636.560634:0:15089:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788638636.560636:0:15089:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788638636.560637:0:15089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788638636.560640:0:15089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638636.560641:0:15089:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788638636.560644:0:15089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788638636.560647:0:15089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638636.560648:0:15089:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788638636.560651:0:15089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788638636.562518:0:15089:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788638636.562527:0:15089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788638636.562534:0:15089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638636.562535:0:15089:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788638636.562538:0:15089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788638636.562542:0:15089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638636.562543:0:15089:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788638636.562547:0:15089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788638636.562614:0:15089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788638636.562618:0:15089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638636.562619:0:15089:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788638636.562623:0:15089:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788638636.563313:0:15075:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788638636.563342:0:15075:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788638636.563364:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385309a00/0xa0b1f1e3b4b2b94d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b954 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638636.563376:0:15075:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7385309a00/0xa0b1f1e3b4b2b94d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b954 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638636.563384:0:15075:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c73b4524000 from 1 10000000:01000000:0.0:1788638636.563387:0:15075:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788638636.563425:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2b969 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638636.563434:0:15075:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2b969 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638636.563451:0:15075:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2b969 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638636.563475:0:15075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183670016:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788638636.563540:0:15075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638636.563581:0:15075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398da8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788638636.563610:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183670016 00000100:00100000:0.0:1788638636.563617:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183670016 00000100:00100000:0.0:1788638636.563670:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788638636.563680:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf62ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+14:15075:x1875523183670016:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788638636.563701:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638636.563715:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b970 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2b969 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638636.563740:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b970 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b969 expref: 15 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638636.563750:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b970 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b969 expref: 15 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638636.563758:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01da00, rc 0) 00000100:00100000:0.0:1788638636.563812:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf62ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+15:15075:x1875523183670016:12345-0@lo:101:mount.lustre.0 Request processed in 134us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638636.563819:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788638636.563866:0:15075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183670016:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788638636.563879:0:15075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2b969 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b970 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638636.563895:0:15075:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2b969 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2b970 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788638636.564421:0:15075:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788638636.575357:0:15075:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788638636.575725:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788638636.575768:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788638636.576181:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788638636.576190:0:15075:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788638636.576281:0:15075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4664700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183670144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788638636.576344:0:15075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638636.576425:0:15075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7399ab3240 going to sleep for 11 seconds 00000100:00100000:3.0:1788638636.582641:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183670144 00000100:00100000:3.0:1788638636.582735:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183670144 00000100:00100000:0.0:1788638636.583105:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788638636.583119:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf62bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+15:15075:x1875523183670144:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788638636.583488:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf62bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+15:15075:x1875523183670144:12345-0@lo:501:mount.lustre.0 Request processed in 372us (7141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638636.583498:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788638636.583525:0:15075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4664700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183670144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788638636.584389:0:15075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4666a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183670272:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788638636.584450:0:15075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638636.584488:0:15075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7399ab3300 going to sleep for 11 seconds 00000100:00100000:0.0:1788638636.584673:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183670272 00000100:00100000:0.0:1788638636.584681:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183670272 00000100:00100000:0.0:1788638636.584736:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788638636.584745:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+15:15075:x1875523183670272:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788638636.584955:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+15:15075:x1875523183670272:12345-0@lo:503:mount.lustre.0 Request processed in 211us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638636.584963:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788638636.585173:0:15075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4666a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183670272:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788638636.585620:0:15075:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788638636.585845:0:15075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183670400:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788638636.585890:0:15075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638636.585919:0:15075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387973000 going to sleep for 11 seconds 00000100:00100000:3.0:1788638636.585927:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183670400 00000100:00100000:3.0:1788638636.585933:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183670400 00000100:00100000:3.0:1788638636.586010:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788638636.586018:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+15:15075:x1875523183670400:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788638636.586181:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+15:15075:x1875523183670400:12345-0@lo:502:mount.lustre.0 Request processed in 162us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638636.586195:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788638636.586239:0:15075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183670400:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788638636.586439:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788638636.586488:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788638636.586531:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788638636.586562:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788638636.586594:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788638636.586647:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788638636.586757:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788638636.587036:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788638636.587063:0:15075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183670528:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788638636.587102:0:15075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638636.587135:0:15075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387973000 going to sleep for 11 seconds 00000100:00100000:3.0:1788638636.587442:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183670528 00000100:00100000:3.0:1788638636.587447:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183670528 00000100:00100000:3.0:1788638636.587486:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788638636.587493:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+15:15075:x1875523183670528:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788638636.588073:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+15:15075:x1875523183670528:12345-0@lo:502:mount.lustre.0 Request processed in 161us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638636.588081:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788638636.588183:0:15075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183670528:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788638636.588295:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788638636.588306:0:15075:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788638636.589626:0:15093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788638636.589638:0:15093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638636.589641:0:15093:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788638636.589648:0:15093:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c73b4524000 00000020:00000080:3.0:1788638636.589650:0:15093:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788638636.589743:0:15093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638636.589747:0:15093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638636.589748:0:15093:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788638636.589751:0:15093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788638636.589754:0:15093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638636.589755:0:15093:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788638636.589759:0:15093:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c73b4524000 00000020:00000080:3.0:1788638636.589761:0:15093:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788638636.589990:0:15093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638636.589994:0:15093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638636.589995:0:15093:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788638636.589998:0:15093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788638636.590001:0:15093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638636.590002:0:15093:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788638636.590006:0:15093:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c73b4524000 00000020:00000080:3.0:1788638636.590008:0:15093:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788638636.590046:0:15093:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638636.590057:0:15093:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638636.590058:0:15093:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788638636.590062:0:15093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1788638636.595360:0:15075:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1788638636.595403:0:15075:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788638636.595430:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2b969 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b970 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638636.595444:0:15075:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2b969 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b970 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638636.595596:0:15075:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788638636.595600:0:15075:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c73b4524000 10000000:01000000:3.0:1788638636.595603:0:15075:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c73b4524000 10000000:01000000:3.0:1788638636.595608:0:15075:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788638636.595614:0:15075:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c73b4524000 from 1 10000000:01000000:3.0:1788638636.595617:0:15075:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788638636.595665:0:15075:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031600/0xa0b1f1e3b4b2b977 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638636.595674:0:15075:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7380031600/0xa0b1f1e3b4b2b977 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638636.595686:0:15075:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7380031600/0xa0b1f1e3b4b2b977 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638636.595720:0:15075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4664000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183670656:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788638636.595816:0:15075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638636.595859:0:15075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387219540 going to sleep for 11 seconds 00000100:00100000:2.0:1788638636.595972:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183670656 00000100:00100000:2.0:1788638636.595979:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183670656 00000100:00100000:2.0:1788638636.596024:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788638636.596032:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+15:15075:x1875523183670656:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788638636.596045:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638636.596057:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2b97e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2b977 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638636.596092:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2b97e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b977 expref: 16 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638636.596103:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7399aa7e00/0xa0b1f1e3b4b2b97e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b977 expref: 16 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638636.596112:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7e00, rc 0) 00000100:00100000:2.0:1788638636.596148:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:15075:x1875523183670656:12345-0@lo:101:mount.lustre.0 Request processed in 117us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638636.596155:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788638636.596240:0:15075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4664000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183670656:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788638636.596255:0:15075:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7380031600/0xa0b1f1e3b4b2b977 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b97e expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638636.596264:0:15075:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7380031600/0xa0b1f1e3b4b2b977 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2b97e expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788638636.596976:0:15075:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788638636.597292:0:15075:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788638636.597556:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788638636.597602:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788638636.597636:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788638636.599863:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788638636.599942:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788638636.599997:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788638636.600037:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788638636.600073:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788638636.600135:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788638636.600174:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788638636.600212:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788638636.600292:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788638636.600335:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788638636.600378:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788638636.600434:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788638636.600471:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788638636.600505:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788638636.600554:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788638636.600590:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788638636.600624:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788638636.600687:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788638636.600735:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788638636.600768:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788638636.600841:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788638636.600878:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788638636.600912:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788638636.600957:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788638636.601012:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788638636.601111:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788638636.601120:0:15075:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788638636.601219:0:15075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4664000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183670784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788638636.601285:0:15075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638636.601342:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183670784 00000100:00100000:3.0:1788638636.601349:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183670784 00000100:00100000:3.0:1788638636.601392:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788638636.601401:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf62a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:15075:x1875523183670784:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788638636.601616:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf62a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:15075:x1875523183670784:12345-0@lo:501:mount.lustre.0 Request processed in 215us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638636.601624:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788638636.601676:0:15075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387219540 going to sleep for 11 seconds 00000100:00100000:3.0:1788638636.607974:0:15075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4664000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183670784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788638636.608036:0:15075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4664000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183670912:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788638636.608113:0:15075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638636.608158:0:15075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387219540 going to sleep for 11 seconds 00000100:00100000:0.0:1788638636.608617:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183670912 00000100:00100000:0.0:1788638636.608627:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183670912 00000100:00100000:0.0:1788638636.608672:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788638636.608680:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:15075:x1875523183670912:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788638636.608906:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:15075:x1875523183670912:12345-0@lo:503:mount.lustre.0 Request processed in 225us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638636.609094:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788638636.609338:0:15075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4664000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183670912:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788638636.611147:0:15075:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788638636.611228:0:15075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4664000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183671040:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788638636.611299:0:15075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638636.611345:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183671040 00000100:00100000:3.0:1788638636.611352:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183671040 00000100:00100000:3.0:1788638636.613342:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788638636.613363:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c739083e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:15075:x1875523183671040:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788638636.613660:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c739083e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:15075:x1875523183671040:12345-0@lo:502:mount.lustre.0 Request processed in 305us (2360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638636.613668:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788638636.614846:0:15075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7387219540 going to sleep for 11 seconds 00000100:00100000:2.0:1788638636.614881:0:15075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4664000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183671040:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788638636.615151:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788638636.615209:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788638636.615247:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788638636.615298:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788638636.615341:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788638636.615408:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788638636.615449:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788638636.615485:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788638636.615537:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788638636.615589:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788638636.615626:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788638636.615676:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788638636.615733:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788638636.615774:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788638636.615876:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788638636.615922:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788638636.615953:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788638636.616009:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788638636.616047:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788638636.616082:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788638636.616131:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788638636.616169:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788638636.616205:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788638636.616254:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788638636.616292:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788638636.616341:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788638636.616388:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788638636.616427:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788638636.616465:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788638636.616517:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788638636.616556:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788638636.616606:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788638636.616669:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788638636.616769:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788638636.616860:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788638636.616921:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788638636.616959:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788638636.616994:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788638636.617044:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788638636.617084:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788638636.617130:0:15075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183671168:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788638636.617207:0:15075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638636.617618:0:15075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bf2adb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788638636.617728:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183671168 00000100:00100000:1.0:1788638636.617736:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183671168 00000100:00100000:1.0:1788638636.617906:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788638636.617915:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c739083e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:15075:x1875523183671168:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788638636.618159:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c739083e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:15075:x1875523183671168:12345-0@lo:502:mount.lustre.0 Request processed in 244us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638636.618167:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788638636.621065:0:15075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183671168:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788638636.621218:0:15075:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788638636.621236:0:15075:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788638636.622226:0:15098:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788638636.622242:0:15098:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9c73ae394d40) 00000020:00000080:2.0:1788638636.622271:0:15098:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788638636.622373:0:15098:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c73b4524000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788638636.622379:0:15098:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c73b4524000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788638636.622381:0:15098:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c73b4524000 3 00010000:00080000:2.0:1788638636.622411:0:15098:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c73b4e1a000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.134@tcp at head 00010000:00010000:2.0:1788638636.624378:0:15098:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1788638636.627137:0:15098:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788638636.627177:0:15098:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788638636.627189:0:15098:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa0b1f1e3b4b2b98c 00000100:00080000:2.0:1788638636.627202:0:15098:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788638636.627207:0:15098:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9c73b4e1a000 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:2.0:1788638636.627736:0:15098:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c738537bb80 x1875523183671296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788638636.627947:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1875523183671296:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788638636.628049:0:15098:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788638636.628161:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638636.628235:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183671296 00000100:00100000:3.0:1788638636.628242:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183671296 00000100:00100000:3.0:1788638636.628358:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638636.628365:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3290:x1875523183671296:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788638636.628389:0:14395:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 399 last 0 00000020:00000080:3.0:1788638636.628420:0:14395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa0b1f1e3b4b2b993 00000004:00100000:3.0:1788638636.628434:0:14395:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788638636.628466:0:14395:0:(import.c:65:import_set_state_nolock()) ffff9c73bf0ec800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788638636.628515:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3290:x1875523183671296:12345-0@lo:38:llog_process_th.0 Request processed in 148us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638636.628522:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788638636.628556:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c738537bb80 x1875523183671296/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788638646 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638636.628567:0:3290:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788638636.628575:0:3290:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1788638636.628581:0:3290:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788638636.628585:0:3290:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788638636.628588:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73b4e1a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788638636.628593:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3290:1875523183671296:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1788638636.629057:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788638636.629063:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788638636.629066:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788638636.629069:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788638636.629363:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183671424:0@lo:400:kworker.0 00000100:00100000:3.0:1788638636.629403:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788638636.630170:0:15098:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:2.0:1788638636.635420:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183671424 00000100:00100000:2.0:1788638636.635435:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183671424 00000100:00100000:2.0:1788638636.635491:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788638636.635501:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183671424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638636.635839:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4667100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183671424:12345-0@lo:400:kworker.0 Request processed in 339us (6434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638636.635847:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:01000000:2.0:1788638636.635875:0:15075:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788638636.635915:0:15075:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788638636.635936:0:15075:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031600/0xa0b1f1e3b4b2b977 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b97e expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638636.635947:0:15075:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7380031600/0xa0b1f1e3b4b2b977 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b97e expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:3.0:1788638636.636390:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9c7385378700 x1875523183671424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638652 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638636.636404:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183671424:0@lo:400:kworker.0 00000020:01000004:2.0:1788638636.636494:0:15075:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788638636.636496:0:15075:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788638636.636497:0:15075:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788638636.636499:0:15075:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788638636.636500:0:15075:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788638636.636502:0:15075:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788638636.636503:0:15075:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788638636.636505:0:15075:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788638636.636506:0:15075:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788638636.636510:0:15075:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788638636.636513:0:15075:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788638636.636514:0:15075:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788638636.636515:0:15075:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788638636.636516:0:15075:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788638636.636517:0:15075:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788638636.636518:0:15075:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788638636.636519:0:15075:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788638636.636520:0:15075:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788638636.636522:0:15075:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788638636.636542:0:15075:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788638636.636559:0:15075:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183671552:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788638636.636606:0:15075:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638636.636633:0:15075:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bf2adb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788638636.636746:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183671552 00000100:00100000:1.0:1788638636.636752:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183671552 00000100:00100000:1.0:1788638636.636812:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788638636.636820:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c739083d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:15075:x1875523183671552:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788638636.636841:0:14387:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788638636.636854:0:14387:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788638636.674456:0:14387:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788638636.674478:0:14387:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788638636.678072:0:14411:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788638636.678083:0:14411:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788638636.678108:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b99a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638636.678128:0:14411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2b907 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b900 expref: 16 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638636.678150:0:14411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b99a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638636.678193:0:14411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2b907 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b900 expref: 16 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638636.678209:0:14411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2b907 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b900 expref: 16 pid: 14389 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638636.678224:0:14411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14411:1875523183671680:0@lo:104: 00000100:00100000:2.0:1788638636.678302:0:14411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638636.678352:0:14411:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bf299d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788638636.678429:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183671680 00000100:00100000:0.0:1788638636.678437:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183671680 00000100:00100000:0.0:1788638636.678501:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788638636.678509:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+3:14411:x1875523183671680:12345-0@lo:104: 00010000:00010000:0.0:1788638636.678522:0:14379:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b900 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2b907 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638636.678577:0:14379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788638636.678584:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+3:14411:x1875523183671680:12345-0@lo:104: Request processed in 76us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638636.678590:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788638636.678764:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638636.678803:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b900 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2b907 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638636.678812:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7000 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:3.0:1788638636.678816:0:14383:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b900 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2b907 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638636.678825:0:14383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2b907 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788638636.678831:0:14383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b900 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2b907 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638636.678837:0:14383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788638636.678865:0:14383:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b900 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2b907 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638636.678872:0:14383:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788638636.678891:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b900 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2b907 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638636.678898:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7399aa7000/0xa0b1f1e3b4b2b900 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2b907 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638636.678914:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638636.678916:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638636.678918:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638636.678940:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183671808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788638636.678975:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638636.679029:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183671808 00000100:00100000:3.0:1788638636.679034:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183671808 00010000:00010000:3.0:1788638636.679052:0:14382:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2b907 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b900 expref: 17 pid: 14389 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638636.679073:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638636.679079:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4665500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+17:3291:x1875523183671808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788638636.679089:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638636.679094:0:14382:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2b907 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b900 expref: 17 pid: 14389 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638636.679103:0:14382:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2b907 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b900 expref: 17 pid: 14389 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638636.679119:0:14382:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b99a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638636.679126:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b99a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788638636.679139:0:14382:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001057421s 00010000:00010000:3.0:1788638636.679144:0:14382:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b99a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638636.679151:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b99a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638636.679158:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b99a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638636.679164:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b99a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638636.679180:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7c00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638636.679184:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b99a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638636.679192:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b99a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638636.679201:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b99a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638636.679212:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638636.679240:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4665500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+17:3291:x1875523183671808:12345-0@lo:103:ldlm_bl.0 Request processed in 162us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638636.679247:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638636.679283:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4666300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183671808:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788638636.680084:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7380031e00/0xa0b1f1e3b4b2b907 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b900 expref: 16 pid: 14389 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638636.680097:0:14411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14411:1875523183671680:0@lo:104: 00010000:00010000:2.0:1788638636.680113:0:14411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b99a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638636.680121:0:14411:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b99a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638636.680127:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b99a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638636.680134:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2b99a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638636.698023:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c739083d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+15:15075:x1875523183671552:12345-0@lo:253:mount.lustre.0 Request processed in 61194us (61406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638636.698036:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788638636.698152:0:15075:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15075:1875523183671552:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788638636.698177:0:15075:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788638636.698180:0:15075:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788638636.698182:0:15075:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788638636.698183:0:15075:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788638636.698185:0:15075:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788638636.698186:0:15075:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788638636.698187:0:15075:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788638636.698188:0:15075:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788638636.698190:0:15075:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788638636.698191:0:15075:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788638636.698206:0:15075:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788638636.707345:0:15075:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788638636.707520:0:15075:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788638636.707936:0:15075:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788638636.708086:0:15075:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788638636.708253:0:15075:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788638636.708532:0:15075:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788638636.711644:0:15075:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788638636.776197:0:15075:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788638636.776208:0:15075:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788638636.776242:0:15075:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788638636.776375:0:15075:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.134@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788638636.776391:0:15075:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788638636.776420:0:15075:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1788638637.087925:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638638.114703:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788638638.241115:0:14391:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788638638.241124:0:14391:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c73908d2000 from 7 10000000:01000000:3.0:1788638638.241130:0:14391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788638638.241178:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2b9a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638638.241191:0:14391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2b9a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638638.241216:0:14391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2b9a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638638.241251:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183671936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788638638.241315:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638638.241372:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398724d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788638638.241504:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183671936 00000100:00100000:0.0:1788638638.241512:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183671936 00000100:00100000:0.0:1788638638.241565:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788638638.241575:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c739083c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+15:14391:x1875523183671936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788638638.241587:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638638.241600:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73bc01d800/0xa0b1f1e3b4b2b9a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2b9a1 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638638.241623:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73bc01d800/0xa0b1f1e3b4b2b9a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b9a1 expref: 16 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638638.241635:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73bc01d800/0xa0b1f1e3b4b2b9a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b9a1 expref: 16 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638638.241644:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01d800, rc 0) 00000100:00100000:0.0:1788638638.241694:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c739083c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:14391:x1875523183671936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638638.241719:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788638638.242535:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4666300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183671936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788638638.242555:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2b9a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b9a8 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638638.242565:0:14391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2b9a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2b9a8 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638638.242634:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183672064:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788638638.242673:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638638.242713:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d90d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788638638.242763:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183672064 00000100:00100000:0.0:1788638638.242769:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183672064 00000100:00100000:0.0:1788638638.242829:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788638638.242838:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c739083c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:14391:x1875523183672064:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788638638.242852:0:14387:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788638638.242867:0:14387:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788638638.242980:0:14387:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788638638.243055:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c739083c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:14391:x1875523183672064:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 219us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638638.243063:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788638638.243696:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183672064:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788638638.243761:0:14391:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788638638.243768:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2b9a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b9a8 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638638.243777:0:14391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2b9a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b9a8 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638639.137855:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638640.161162:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638641.184508:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788638641.785654:0:15444:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg334-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1788638641.888925:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788638641.888932:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788638641.888935:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788638641.888938:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788638641.888972:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788638641.888992:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183672192:0@lo:400:kworker.0 00000100:00100000:3.0:1788638641.889059:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638641.889114:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183672320:0@lo:400:kworker.0 00000100:00100000:3.0:1788638641.889141:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638641.889161:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788638641.889167:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183672448:0@lo:400:kworker.0 00000100:00100000:3.0:1788638641.889188:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638641.889217:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183672192 00000100:00100000:3.0:1788638641.889224:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183672192 00000100:00100000:2.0:1788638641.889322:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183672320 00000100:00100000:2.0:1788638641.889326:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183672320 00000100:00100000:2.0:1788638641.889361:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183672448 00000100:00100000:2.0:1788638641.889364:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183672448 00000100:00100000:2.0:1788638641.889389:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788638641.889397:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183672320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638641.889443:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4665880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183672320:12345-0@lo:400:kworker.0 Request processed in 46us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638641.889449:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788638641.889465:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788638641.889470:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183672448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638641.889490:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183672448:12345-0@lo:400:kworker.0 Request processed in 20us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638641.889495:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788638641.889529:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73b4664e00 x1875523183672448/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638641.889542:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183672448:0@lo:400:kworker.0 00010000:00080000:2.0:1788638641.889553:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73b4667b80 x1875523183672320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638641.889578:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4667b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183672320:0@lo:400:kworker.0 00000100:00100000:3.0:1788638641.889708:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788638641.889715:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c739083ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:3291:x1875523183672192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638641.889750:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c739083ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:3291:x1875523183672192:12345-0@lo:400:kworker.0 Request processed in 35us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638641.889765:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788638641.889827:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183672192:0@lo:400:kworker.0 00000100:00080000:0.0:1788638641.893690:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788638642.208105:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638643.231977:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638644.256515:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638645.281187:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788638645.933928:0:14429:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788638646.304246:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788638647.008028:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788638647.008038:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788638647.008041:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788638647.008045:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788638647.008191:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183672704:0@lo:400:kworker.0 00000100:00100000:3.0:1788638647.008299:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638647.008374:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788638647.008381:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3292:1875523183672576:0@lo:400:kworker.0 00000100:00100000:3.0:1788638647.008426:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638647.008462:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183672832:0@lo:400:kworker.0 00000100:00100000:3.0:1788638647.008489:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638647.008527:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183672704 00000100:00100000:3.0:1788638647.008537:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183672704 00000100:00100000:3.0:1788638647.008874:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183672832 00000100:00100000:3.0:1788638647.008880:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183672832 00000100:00100000:3.0:1788638647.008916:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788638647.008926:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183672704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638647.009000:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3292:x1875523183672704:12345-0@lo:400:kworker.0 Request processed in 73us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638647.009009:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788638647.009028:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788638647.009053:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183672832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638647.009088:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183672832:12345-0@lo:400:kworker.0 Request processed in 37us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638647.009094:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788638647.009114:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183672576 00000100:00100000:3.0:1788638647.009118:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183672576 00000100:00100000:3.0:1788638647.009144:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788638647.009150:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:3292:x1875523183672576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638647.009182:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:3292:x1875523183672576:12345-0@lo:400:kworker.0 Request processed in 32us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638647.009188:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1788638647.009330:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788638647.009372:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73b4666a00 x1875523183672832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638647.009389:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4666a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183672832:0@lo:400:kworker.0 00000100:00100000:3.0:1788638647.014087:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4664a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3292:1875523183672576:0@lo:400:kworker.0 00010000:00080000:3.0:1788638647.014137:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73b4664000 x1875523183672704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638647.014152:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4664000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3292:1875523183672704:0@lo:400:kworker.0 00010000:00010000:3.0:1788638647.328032:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638648.364375:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638648.864025:0:3290:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788638633/real 1788638633] req@ffff9c73b4666680 x1875523183668608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788638648 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638648.864066:0:3290:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c73b4666680 x1875523183668608/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788638648 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638648.864088:0:3290:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788638633/real 1788638633] req@ffff9c73b4667480 x1875523183668736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788638648 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638648.864104:0:3290:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9c73b4667480 x1875523183668736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788638648 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788638648.864127:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73bce5f000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788638648.864159:0:3290:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788638648.864164:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183668608:0@lo:8:kworker.0 00000100:00080000:3.0:1788638648.864170:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73bce59800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788638648.864176:0:3290:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788638648.864179:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183668736:0@lo:8:kworker.0 00000100:00080000:0.0:1788638648.864871:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788638648.864877:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788638648.864880:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c73bce5f000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788638648.864887:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 396 00000100:00080000:0.0:1788638648.864895:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788638648.864902:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9c73bce5f000 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:0.0:1788638648.864926:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73bf61ea00 x1875523183673088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788638648.864942:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788638648.864945:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788638648.864947:0:37:0:(import.c:65:import_set_state_nolock()) ffff9c73bce59800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788638648.864950:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 396 00000100:00080000:0.0:1788638648.864953:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788638648.864964:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c73bce59800 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:0.0:1788638648.864976:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73bf61f100 x1875523183673216/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788638648.865039:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183673344:0@lo:400:kworker.0 00000100:00100000:0.0:1788638648.865124:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638648.865189:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638648.865195:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183673472:0@lo:400:kworker.0 00000100:00100000:0.0:1788638648.865237:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638648.865281:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183673344 00000100:00100000:0.0:1788638648.865290:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183673344 00000100:00100000:0.0:1788638648.865344:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183673472 00000100:00100000:0.0:1788638648.865347:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183673472 00000100:00100000:0.0:1788638648.865363:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788638648.865374:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183673344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638648.865430:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183673344:12345-0@lo:400:kworker.0 Request processed in 57us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638648.865439:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788638648.865457:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788638648.865463:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183673472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638648.865489:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183673472:12345-0@lo:400:kworker.0 Request processed in 27us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638648.865495:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788638648.865514:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183673088:0@lo:8:kworker.0 00000100:00100000:0.0:1788638648.865544:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638648.865567:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183673216:0@lo:8:kworker.0 00000100:00100000:0.0:1788638648.865588:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788638648.865653:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73bf61c380 x1875523183673472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638648.865669:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183673472:0@lo:400:kworker.0 00010000:00080000:0.0:1788638648.865681:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73bf61ca80 x1875523183673344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638664 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638648.865688:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183673344:0@lo:400:kworker.0 00000100:00100000:1.0:1788638648.865995:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3294:1875523183672960:0@lo:400:kworker.0 00000100:00100000:1.0:1788638648.866037:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638648.866090:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183673088 00000100:00100000:1.0:1788638648.866094:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183673088 00000100:00100000:1.0:1788638648.866119:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183673216 00000100:00100000:1.0:1788638648.866121:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183673216 00000100:00100000:1.0:1788638648.866130:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788638648.866135:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3290:x1875523183673088:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788638648.866161:0:15077:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:1.0:1788638648.866199:0:15077:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa0b1f1e3b4b2b9af 00002000:00100000:1.0:1788638648.866224:0:15077:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9c73acdc6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788638648.866228:0:15077:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788638648.866231:0:15077:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788638648.866866:0:15077:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788638648.866898:0:15077:0:(import.c:65:import_set_state_nolock()) ffff9c73acdc0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788638648.866956:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3290:x1875523183673088:12345-0@lo:8:kworker.0 Request processed in 818us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638648.866965:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788638648.866988:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788638648.866993:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3290:x1875523183673216:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788638648.867025:0:15077:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788638648.867051:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3290:x1875523183673216:12345-0@lo:8:kworker.0 Request processed in 57us (1462us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788638648.867057:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788638648.869745:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183672960 00000100:00100000:0.0:1788638648.869764:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183672960 00000100:00100000:0.0:1788638648.869842:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788638648.869853:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:3294:x1875523183672960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638648.869964:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:3294:x1875523183672960:12345-0@lo:400:kworker.0 Request processed in 112us (3924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638648.869972:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788638648.870047:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3294:1875523183672960:0@lo:400:kworker.0 00010000:00080000:0.0:1788638648.870117:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73bf61ea00 x1875523183673088/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788638668 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638648.870130:0:3290:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788638648.870141:0:3290:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788638648.870151:0:3290:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788638648.870159:0:3290:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788638648.870163:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73bce5f000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788638648.870178:0:3290:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788638648.870185:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183673088:0@lo:8:kworker.0 00000100:00080000:0.0:1788638648.870200:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73bce59800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788638648.870225:0:3290:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788638648.870229:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183673216:0@lo:8:kworker.0 00000004:00080000:1.0:1788638648.871420:0:14417:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788638648.872472:0:14417:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 411943686259ns, next at 0ns, rc = 0 00000004:00080000:0.0:1788638648.874811:0:14418:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788638648.874861:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14418:1875523183673728:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788638648.874949:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638648.874991:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7384d41480 going to sleep for 11 seconds 00000100:00100000:0.0:1788638648.875025:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183673600:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788638648.875051:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638648.875133:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183673728 00000100:00100000:0.0:1788638648.875142:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183673728 00000100:00100000:0.0:1788638648.875219:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788638648.875229:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14418:x1875523183673728:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:1.0:1788638648.878127:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788638648.878507:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183673600 00000100:00100000:3.0:1788638648.878538:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183673600 00000100:00100000:3.0:1788638648.878626:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638648.878639:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1875523183673600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788638648.878688:0:15080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788638648.878821:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3293:x1875523183673600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 185us (3768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638648.878829:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788638648.893115:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73bf61f100 x1875523183673600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638664 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638648.893153:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183673600:0@lo:13:osp-pre-0-0.0 00002000:00080000:0.0:1788638648.905668:0:15077:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1788638648.905685:0:15077:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1788638648.905693:0:15077:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:0.0:1788638648.919448:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.919522:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000debe86e7/0xa0b1f1e3b4b2b9b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.919540:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1788638648.919567:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.919575:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000debe86e7/0xa0b1f1e3b4b2b9b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.919603:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000debe86e7/0xa0b1f1e3b4b2b9b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.920864:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000debe86e7/0xa0b1f1e3b4b2b9b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.920875:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000debe86e7/0xa0b1f1e3b4b2b9b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.920906:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638648.920925:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638648.920931:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000debe86e7/0xa0b1f1e3b4b2b9b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.920940:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01dc00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638648.920945:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000debe86e7/0xa0b1f1e3b4b2b9b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.920955:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000debe86e7/0xa0b1f1e3b4b2b9b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.920974:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000debe86e7/0xa0b1f1e3b4b2b9b6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.920983:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000debe86e7/0xa0b1f1e3b4b2b9b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.921015:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.921017:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.921019:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638648.921874:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.921883:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea2f2fb5/0xa0b1f1e3b4b2b9bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.921898:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1788638648.921903:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.921911:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea2f2fb5/0xa0b1f1e3b4b2b9bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.921925:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea2f2fb5/0xa0b1f1e3b4b2b9bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.921934:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea2f2fb5/0xa0b1f1e3b4b2b9bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.921942:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea2f2fb5/0xa0b1f1e3b4b2b9bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.921966:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638648.921979:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638648.921985:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea2f2fb5/0xa0b1f1e3b4b2b9bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.922006:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01de00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638648.922010:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea2f2fb5/0xa0b1f1e3b4b2b9bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.922019:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea2f2fb5/0xa0b1f1e3b4b2b9bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.922034:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea2f2fb5/0xa0b1f1e3b4b2b9bd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.922042:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea2f2fb5/0xa0b1f1e3b4b2b9bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.922062:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.922063:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.922065:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638648.922720:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.922727:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae5c94c0/0xa0b1f1e3b4b2b9c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.922738:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1788638648.922742:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.922746:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ae5c94c0/0xa0b1f1e3b4b2b9c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.922756:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ae5c94c0/0xa0b1f1e3b4b2b9c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.922770:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ae5c94c0/0xa0b1f1e3b4b2b9c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.922778:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ae5c94c0/0xa0b1f1e3b4b2b9c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.922814:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638648.922823:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638648.922827:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ae5c94c0/0xa0b1f1e3b4b2b9c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.922835:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c400 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638648.922838:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae5c94c0/0xa0b1f1e3b4b2b9c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.922847:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ae5c94c0/0xa0b1f1e3b4b2b9c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.922858:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ae5c94c0/0xa0b1f1e3b4b2b9c4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.922866:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ae5c94c0/0xa0b1f1e3b4b2b9c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.922880:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.922887:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.922888:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638648.923362:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.923368:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb5bdb4c/0xa0b1f1e3b4b2b9cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.923378:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1788638648.923382:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.923386:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb5bdb4c/0xa0b1f1e3b4b2b9cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.923398:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb5bdb4c/0xa0b1f1e3b4b2b9cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.923408:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb5bdb4c/0xa0b1f1e3b4b2b9cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.923416:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb5bdb4c/0xa0b1f1e3b4b2b9cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.923432:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638648.923443:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638648.923447:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb5bdb4c/0xa0b1f1e3b4b2b9cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.923455:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638648.923533:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb5bdb4c/0xa0b1f1e3b4b2b9cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.923557:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb5bdb4c/0xa0b1f1e3b4b2b9cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.923570:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb5bdb4c/0xa0b1f1e3b4b2b9cb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.923578:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb5bdb4c/0xa0b1f1e3b4b2b9cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.923599:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.923602:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.923603:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638648.924376:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.924386:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2b9d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.924398:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1788638648.924403:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.924409:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2b9d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.924422:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2b9d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.924432:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2b9d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.924446:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2b9d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.924529:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638648.924541:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638648.924546:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2b9d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.924554:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01cc00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638648.924559:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2b9d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.924569:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2b9d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.924586:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2b9d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.924594:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfaa34ea/0xa0b1f1e3b4b2b9d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.924626:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.924628:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.924631:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638648.925444:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.925525:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b9d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.925538:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1788638648.925544:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.925550:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b9d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.925562:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b9d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.925572:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b9d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.925580:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b9d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.925602:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638648.925622:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638648.925626:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b9d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.925634:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638648.925638:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b9d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.925646:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b9d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.925665:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b9d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.925673:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a880bf00/0xa0b1f1e3b4b2b9d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.925689:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.925690:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.925692:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638648.926087:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.926093:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2b9e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.926102:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1788638648.926105:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.926110:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2b9e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.926119:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2b9e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.926128:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2b9e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.926135:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2b9e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.926162:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638648.926171:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638648.926175:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2b9e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.926182:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d200 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638648.926186:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2b9e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.926195:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2b9e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.926317:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2b9e0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.926327:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c1d7e0fc/0xa0b1f1e3b4b2b9e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.926341:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.926342:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.926344:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638648.927656:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.927667:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2b9e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.927682:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1788638648.927693:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.927699:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2b9e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.927711:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2b9e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.927720:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2b9e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.927729:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2b9e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.927748:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638648.927760:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638648.927765:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2b9e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.927772:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c200 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638648.927777:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2b9e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.927800:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2b9e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.927814:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2b9e7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.927834:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2b9e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.927852:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.927854:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.927856:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638648.928242:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.928249:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019b6c2e6/0xa0b1f1e3b4b2b9ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.928257:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1788638648.928261:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.928265:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019b6c2e6/0xa0b1f1e3b4b2b9ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.928274:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019b6c2e6/0xa0b1f1e3b4b2b9ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.928282:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019b6c2e6/0xa0b1f1e3b4b2b9ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.928289:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019b6c2e6/0xa0b1f1e3b4b2b9ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.928305:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638648.928314:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638648.928323:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019b6c2e6/0xa0b1f1e3b4b2b9ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.928330:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d400 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638648.928334:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019b6c2e6/0xa0b1f1e3b4b2b9ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.928343:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019b6c2e6/0xa0b1f1e3b4b2b9ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.928354:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019b6c2e6/0xa0b1f1e3b4b2b9ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.928361:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019b6c2e6/0xa0b1f1e3b4b2b9ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.928375:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.928376:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.928378:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638648.928800:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.928807:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000610063e8/0xa0b1f1e3b4b2b9f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.928816:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=411s v=(0 0) 00010000:00010000:0.0:1788638648.928819:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.928824:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000610063e8/0xa0b1f1e3b4b2b9f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.928844:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000610063e8/0xa0b1f1e3b4b2b9f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.928853:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000610063e8/0xa0b1f1e3b4b2b9f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.928860:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000610063e8/0xa0b1f1e3b4b2b9f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.928873:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638648.928881:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638648.928885:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000610063e8/0xa0b1f1e3b4b2b9f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.928891:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01ca00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638648.928894:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000610063e8/0xa0b1f1e3b4b2b9f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.928901:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000610063e8/0xa0b1f1e3b4b2b9f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.928911:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000610063e8/0xa0b1f1e3b4b2b9f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.928918:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000610063e8/0xa0b1f1e3b4b2b9f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.928938:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.928939:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.928941:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638648.933635:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.933648:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f271b24/0xa0b1f1e3b4b2b9fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.933665:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1788638648.933670:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.933676:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f271b24/0xa0b1f1e3b4b2b9fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.933693:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f271b24/0xa0b1f1e3b4b2b9fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.933704:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f271b24/0xa0b1f1e3b4b2b9fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.933712:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f271b24/0xa0b1f1e3b4b2b9fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.933969:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788638648.934595:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.934604:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2ba03 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.934634:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1788638648.934637:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.934642:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2ba03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.934653:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2ba03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.934661:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2ba03 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.934668:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2ba03 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.935061:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788638648.935068:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f271b24/0xa0b1f1e3b4b2b9fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.935076:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d600 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638648.935081:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f271b24/0xa0b1f1e3b4b2b9fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.935090:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f271b24/0xa0b1f1e3b4b2b9fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.935107:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f271b24/0xa0b1f1e3b4b2b9fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.935114:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f271b24/0xa0b1f1e3b4b2b9fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.935135:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638648.935138:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2ba03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.935143:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467e00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638648.935146:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2ba03 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.935163:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2ba03 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.935172:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2ba03 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.935179:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.935180:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.935182:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.935443:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788638648.935448:0:15077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2ba03 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788638648.936499:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.936508:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.936520:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1788638648.936524:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.936530:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.936557:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.936566:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.936575:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.936758:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638648.936766:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.937015:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638648.937022:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.937032:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba0a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.937048:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba0a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.937059:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.937064:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.937067:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.937220:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788638648.937226:0:15077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788638648.938748:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.938759:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2ba11 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.939071:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1788638648.939078:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.939085:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2ba11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.939100:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2ba11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.939127:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2ba11 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.939137:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2ba11 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.939199:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638648.939206:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2ba11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.939215:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638648.939219:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2ba11 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.939229:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2ba11 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.939352:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2ba11 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.939362:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.939364:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.939366:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.939462:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788638648.939467:0:15077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2ba11 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788638648.940089:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.940096:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020b09824/0xa0b1f1e3b4b2ba18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.940106:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1788638648.940110:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.940115:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020b09824/0xa0b1f1e3b4b2ba18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.940125:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020b09824/0xa0b1f1e3b4b2ba18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.940133:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020b09824/0xa0b1f1e3b4b2ba18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.940151:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020b09824/0xa0b1f1e3b4b2ba18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.945243:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638648.945910:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020b09824/0xa0b1f1e3b4b2ba18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.945927:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466e00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638648.945933:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020b09824/0xa0b1f1e3b4b2ba18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.945943:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020b09824/0xa0b1f1e3b4b2ba18 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.945985:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020b09824/0xa0b1f1e3b4b2ba18 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.945995:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.945997:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.945999:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.946093:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788638648.946101:0:15077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020b09824/0xa0b1f1e3b4b2ba18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.947269:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638648.948160:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.948169:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011593419/0xa0b1f1e3b4b2ba1f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.948183:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1788638648.948187:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.948193:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000011593419/0xa0b1f1e3b4b2ba1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.948204:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000011593419/0xa0b1f1e3b4b2ba1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.948213:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000011593419/0xa0b1f1e3b4b2ba1f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.948220:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000011593419/0xa0b1f1e3b4b2ba1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.948420:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788638648.949011:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.949019:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2ba26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.949028:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1788638648.949031:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.949035:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2ba26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.949047:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2ba26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.949056:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2ba26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.949063:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2ba26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.951113:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788638648.951127:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000011593419/0xa0b1f1e3b4b2ba1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.951142:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467200 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638648.951148:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000011593419/0xa0b1f1e3b4b2ba1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.951161:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000011593419/0xa0b1f1e3b4b2ba1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.951182:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000011593419/0xa0b1f1e3b4b2ba1f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.951191:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000011593419/0xa0b1f1e3b4b2ba1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.951224:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638648.951228:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2ba26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.951249:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638648.951253:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2ba26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.951262:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2ba26 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.951273:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2ba26 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.951281:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.951283:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.951285:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.953061:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788638648.953074:0:15077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2ba26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.953177:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638648.953959:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.953966:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba2d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.953987:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1788638648.953992:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.953998:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.954012:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.954022:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba2d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.954030:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.954054:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638648.954068:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638648.954074:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.954081:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638648.954089:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba2d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.954098:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba2d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.954127:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba2d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.954135:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba2d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.954162:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.954164:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.954166:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638648.954939:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.954948:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2ba34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.954958:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1788638648.954962:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.954966:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2ba34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.954976:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2ba34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.954984:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2ba34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.954992:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2ba34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.955029:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788638648.955117:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638648.955128:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2ba34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.955139:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467e00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638648.955144:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2ba34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.955168:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2ba34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.955191:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2ba34 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.955209:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1c2805b/0xa0b1f1e3b4b2ba34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.955232:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.955234:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.955236:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638648.955656:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.955663:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2ba3b lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.955672:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1788638648.955675:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.955680:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2ba3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.955688:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2ba3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.955695:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2ba3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.955702:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2ba3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.955720:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788638648.955747:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638648.955753:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2ba3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.955762:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466600 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638648.955766:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2ba3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.955775:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2ba3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.955813:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2ba3b lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.955821:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2ba3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.955836:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.955837:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.955839:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638648.956644:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.956651:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2ba42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.956660:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1788638648.956670:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.956675:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2ba42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.956687:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2ba42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.956695:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2ba42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.956703:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2ba42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.956718:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788638648.957104:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638648.957111:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2ba42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.957119:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638648.957123:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2ba42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.957132:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2ba42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.957146:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2ba42 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.957163:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046448853/0xa0b1f1e3b4b2ba42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.957186:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.957189:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.957190:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638648.959638:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.959649:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2ba49 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.959665:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1788638648.959669:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.959675:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2ba49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.959689:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2ba49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.959698:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2ba49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.959714:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2ba49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.959736:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638648.959748:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638648.959754:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2ba49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.959762:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467800 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638648.959767:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2ba49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.959946:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2ba49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.959963:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2ba49 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.959969:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093e5fd51/0xa0b1f1e3b4b2ba49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.959988:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.959990:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.959991:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638648.960629:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.960644:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7732520/0xa0b1f1e3b4b2ba50 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.960653:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1788638648.960658:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.960662:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d7732520/0xa0b1f1e3b4b2ba50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.960672:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d7732520/0xa0b1f1e3b4b2ba50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.960680:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d7732520/0xa0b1f1e3b4b2ba50 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.960687:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d7732520/0xa0b1f1e3b4b2ba50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.960707:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788638648.960746:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638648.960754:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d7732520/0xa0b1f1e3b4b2ba50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.960764:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466200 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638648.960769:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7732520/0xa0b1f1e3b4b2ba50 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.960809:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d7732520/0xa0b1f1e3b4b2ba50 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.960822:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d7732520/0xa0b1f1e3b4b2ba50 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.960830:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d7732520/0xa0b1f1e3b4b2ba50 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.960855:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.960857:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.960859:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638648.962060:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.962071:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba57 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.962084:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1788638648.962088:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.962094:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.962106:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.962121:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.962129:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.962158:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788638648.962187:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638648.962195:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.962203:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638648.962208:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.962217:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.962231:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba57 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.962251:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014f655e1/0xa0b1f1e3b4b2ba57 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.962272:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.962279:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.962286:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638648.963194:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.963203:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2ba5e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.963214:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1788638648.963217:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.963222:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2ba5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.963360:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2ba5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.963372:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2ba5e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.963379:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2ba5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.963415:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788638648.964026:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.964032:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020b09824/0xa0b1f1e3b4b2ba65 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.964041:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1788638648.964045:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.964049:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000020b09824/0xa0b1f1e3b4b2ba65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.964057:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000020b09824/0xa0b1f1e3b4b2ba65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.964064:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000020b09824/0xa0b1f1e3b4b2ba65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.964071:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000020b09824/0xa0b1f1e3b4b2ba65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.964090:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788638648.964103:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788638648.964106:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2ba5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.964113:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638648.964123:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2ba5e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.964131:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2ba5e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.964143:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638648.964146:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2ba5e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.964155:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2ba5e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.964170:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.964172:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638648.964173:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.964676:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.964683:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000020b09824/0xa0b1f1e3b4b2ba65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.964692:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466e00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638648.964695:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000020b09824/0xa0b1f1e3b4b2ba65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.964704:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000020b09824/0xa0b1f1e3b4b2ba65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.964716:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000020b09824/0xa0b1f1e3b4b2ba65 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.964723:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000020b09824/0xa0b1f1e3b4b2ba65 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.964739:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.964741:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.964749:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.964753:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.964755:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638648.965647:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.965654:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2ba6c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.965664:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1788638648.965668:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.965673:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2ba6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.965685:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2ba6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.965693:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2ba6c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.965709:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2ba6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.965732:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788638648.965873:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638648.965879:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2ba6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.965887:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466400 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638648.965892:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2ba6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.965899:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2ba6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.965911:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2ba6c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.965918:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2ba6c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.965933:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.965935:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.965937:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788638648.967058:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788638648.967066:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2ba73 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.967078:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=412s v=(0 0) 00010000:00010000:0.0:1788638648.967082:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638648.967087:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2ba73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.967098:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2ba73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.967106:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2ba73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.967114:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2ba73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638648.967132:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788638648.967393:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638648.967399:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2ba73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.967406:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466c00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638648.967415:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2ba73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.967424:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2ba73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.967437:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2ba73 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.967445:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7f30168/0xa0b1f1e3b4b2ba73 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638648.967471:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.967473:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638648.967477:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788638648.967744:0:15077:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:0.0:1788638648.967862:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14418:x1875523183673728:12345-0@lo:5:osp-pre-0-0.0 Request processed in 92632us (92909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638648.967878:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788638648.967943:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14418:1875523183673728:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788638648.967959:0:14418:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788638648.968004:0:14418:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14418:1875523183673856:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788638648.968040:0:14418:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638648.968093:0:14418:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7393d946c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638648.968121:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183673856 00000100:00100000:0.0:1788638648.968128:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183673856 00000100:00100000:0.0:1788638648.968179:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788638648.968190:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14418:x1875523183673856:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788638648.968223:0:15079:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000004:00080000:1.0:1788638648.981040:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788638648.982924:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14418:x1875523183673856:12345-0@lo:5:osp-pre-0-0.0 Request processed in 14731us (14878us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788638648.982936:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788638648.985119:0:14418:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14418:1875523183673856:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788638648.985149:0:14418:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1788638649.379153:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788638649.441830:0:15795:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788638649.441834:0:15795:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788638649.441998:0:15795:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9c73bf0eb800 00000020:01000004:3.0:1788638649.442018:0:15795:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788638649.442033:0:15795:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788638649.442050:0:15795:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9c7387d499c0) 00000020:00000080:3.0:1788638649.442069:0:15795:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788638649.481824:0:15795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788638649.483724:0:15795:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788638649.488002:0:15795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788638649.488716:0:15795:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788638649.489020:0:15795:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788638649.489777:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 417: rc = 0 00100000:10000000:2.0:1788638649.490015:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 417: rc = 0 00100000:10000000:2.0:1788638649.490139:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 417: rc = 0 00100000:10000000:2.0:1788638649.491464:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 771: rc = 0 00100000:10000000:2.0:1788638649.499980:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 771: rc = 0 00100000:10000000:2.0:1788638649.508717:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 771: rc = 0 00100000:10000000:2.0:1788638649.509205:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 771: rc = 0 00100000:10000000:2.0:1788638649.509506:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 771: rc = 0 00100000:10000000:2.0:1788638649.509847:0:15795:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 771: rc = 0 00000020:00000080:2.0:1788638649.510477:0:15795:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788638649.510493:0:15795:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788638649.510507:0:15795:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa0b1f1e3b4b2ba81 00000020:01000004:2.0:1788638649.510517:0:15795:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788638649.510544:0:15795:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.134@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788638649.510549:0:15795:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.134@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788638649.510554:0:15795:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788638649.510579:0:15795:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788638649.510584:0:15795:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.134@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788638649.541963:0:15795:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.134@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788638649.542016:0:15795:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.134@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788638649.542022:0:15795:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788638649.542025:0:15795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788638649.542026:0:15795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788638649.542027:0:15795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788638649.542029:0:15795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788638649.542030:0:15795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788638649.542032:0:15795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788638649.542034:0:15795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788638649.542036:0:15795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788638649.542041:0:15795:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788638649.542044:0:15795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788638649.542046:0:15795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788638649.542047:0:15795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788638649.542048:0:15795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788638649.542049:0:15795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788638649.542050:0:15795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788638649.542051:0:15795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788638649.542053:0:15795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788638649.542054:0:15795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788638649.542092:0:15795:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788638649.542121:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4667480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183673984:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788638649.542236:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638649.542310:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398581d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788638649.542651:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183673984 00000100:00100000:0.0:1788638649.542662:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183673984 00000100:00100000:0.0:1788638649.542732:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788638649.542744:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:15795:x1875523183673984:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788638649.542845:0:14388:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788638649.542849:0:14388:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788638649.542853:0:14388:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788638649.557161:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:15795:x1875523183673984:12345-0@lo:253:mount.lustre.0 Request processed in 14405us (14911us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638649.557190:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788638649.557668:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4667480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183673984:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788638649.557691:0:15795:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788638649.557696:0:15795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788638649.557698:0:15795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788638649.557699:0:15795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788638649.557701:0:15795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788638649.557702:0:15795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788638649.557703:0:15795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788638649.557705:0:15795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788638649.557708:0:15795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788638649.557710:0:15795:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788638649.557765:0:15795:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9c73bf0eb800 from lustre-OST0001 10000000:01000000:3.0:1788638649.557958:0:15795:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788638649.557962:0:15795:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788638649.557972:0:15795:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9c7387d4b380 local copy 00010000:00010000:3.0:1788638649.557985:0:15795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b827 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b82e expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638649.558656:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4667480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183674112:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788638649.558730:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638649.558891:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398770e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788638649.559027:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183674112 00000100:00100000:1.0:1788638649.559036:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183674112 00000100:00100000:1.0:1788638649.559145:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788638649.559156:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:15795:x1875523183674112:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788638649.559470:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:15795:x1875523183674112:12345-0@lo:501:mount.lustre.0 Request processed in 314us (739us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788638649.559488:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788638649.559706:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4667480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183674112:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788638649.559727:0:15795:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.134@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788638649.560162:0:15795:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.134@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788638649.560174:0:15795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b827 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b82e expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638649.560187:0:15795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c600/0xa0b1f1e3b4b2b827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2b82e expref: -99 pid: 14377 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638649.560220:0:15795:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9c73bf0eb800 10000000:01000000:3.0:1788638649.560226:0:15795:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788638649.560232:0:15795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788638649.560235:0:15795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788638649.560241:0:15795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788638649.560244:0:15795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788638649.560291:0:15795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031c00/0xa0b1f1e3b4b2ba88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638649.560301:0:15795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7380031c00/0xa0b1f1e3b4b2ba88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638649.560322:0:15795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7380031c00/0xa0b1f1e3b4b2ba88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638649.560344:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4667480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183674240:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788638649.560401:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638649.561152:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398770e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788638649.562090:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183674240 00000100:00100000:2.0:1788638649.562101:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183674240 00000100:00100000:3.0:1788638649.562243:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788638649.562255:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:15795:x1875523183674240:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788638649.562282:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638649.562303:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7380030400/0xa0b1f1e3b4b2ba8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2ba88 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638649.562336:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7380030400/0xa0b1f1e3b4b2ba8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2ba88 expref: 17 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638649.562350:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7380030400/0xa0b1f1e3b4b2ba8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2ba88 expref: 17 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638649.562371:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030400, rc 0) 00000100:00100000:3.0:1788638649.562450:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+17:15795:x1875523183674240:12345-0@lo:101:mount.lustre.0 Request processed in 197us (2049us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638649.562457:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788638649.562838:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4667480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183674240:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788638649.562861:0:15795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7380031c00/0xa0b1f1e3b4b2ba88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2ba8f expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638649.562872:0:15795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7380031c00/0xa0b1f1e3b4b2ba88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2ba8f expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788638649.564135:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788638649.565923:0:15795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788638649.566253:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788638649.566777:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788638649.566831:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788638649.566913:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788638649.566956:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788638649.566994:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788638649.567073:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788638649.567090:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788638649.567557:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183674368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788638649.567706:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638649.567764:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73ad646e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788638649.567869:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183674368 00000100:00100000:3.0:1788638649.567878:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183674368 00000100:00100000:3.0:1788638649.567937:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788638649.567946:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+17:15795:x1875523183674368:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788638649.569064:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+17:15795:x1875523183674368:12345-0@lo:501:mount.lustre.0 Request processed in 1114us (1354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638649.569083:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788638649.569733:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183674368:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788638649.569811:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183674496:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788638649.569874:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638649.569919:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73ad646e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788638649.569982:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183674496 00000100:00100000:3.0:1788638649.569989:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183674496 00000100:00100000:3.0:1788638649.570035:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788638649.570044:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+17:15795:x1875523183674496:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788638649.576193:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+17:15795:x1875523183674496:12345-0@lo:503:mount.lustre.0 Request processed in 6127us (6296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638649.576436:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385379c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183674496:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788638649.577698:0:15795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788638649.577858:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183674624:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788638649.577950:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638649.578009:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7393d946c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638649.578635:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788638649.578699:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183674624 00000100:00100000:3.0:1788638649.578707:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183674624 00000100:00100000:3.0:1788638649.578754:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788638649.578764:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+17:15795:x1875523183674624:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788638649.579052:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+17:15795:x1875523183674624:12345-0@lo:502:mount.lustre.0 Request processed in 288us (1101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638649.579061:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788638649.579687:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183674624:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788638649.580080:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788638649.580142:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788638649.580881:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788638649.580965:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788638649.581004:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788638649.581036:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788638649.581108:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788638649.581161:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788638649.581468:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788638649.581673:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183674752:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788638649.581767:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638649.581917:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7393d946c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638649.582025:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183674752 00000100:00100000:3.0:1788638649.582035:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183674752 00000100:00100000:3.0:1788638649.582128:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788638649.582139:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+17:15795:x1875523183674752:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788638649.582733:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+17:15795:x1875523183674752:12345-0@lo:502:mount.lustre.0 Request processed in 593us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638649.582742:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788638649.582859:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183674752:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788638649.582959:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788638649.582974:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788638649.584773:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788638649.584814:0:15796:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788638649.584823:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788638649.584826:0:15796:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788638649.584835:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788638649.584853:0:15796:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9c73ad9c0000) 00000020:00000080:1.0:1788638649.584881:0:15796:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788638649.584904:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788638649.584999:0:15796:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c73bf0eb800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788638649.585009:0:15796:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788638649.585023:0:15796:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa0b1f1e3b4b2ba9d 00010000:00010000:1.0:1788638649.591310:0:15796:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788638649.592054:0:15796:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1788638649.594257:0:15796:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:3.0:1788638649.598067:0:15796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1788638649.598085:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638649.598096:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638649.598098:0:15796:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1788638649.598126:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788638649.598131:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638649.598133:0:15796:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788638649.598136:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788638649.598138:0:15796:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788638649.598140:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638649.598143:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638649.598144:0:15796:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788638649.598146:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788638649.598148:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638649.598150:0:15796:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788638649.598154:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788638649.598462:0:15796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638649.598467:0:15796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638649.598469:0:15796:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788638649.598472:0:15796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:0.0:1788638649.599756:0:15795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:0.0:1788638649.599910:0:15795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1788638649.599935:0:15795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031c00/0xa0b1f1e3b4b2ba88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2ba8f expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638649.599950:0:15795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7380031c00/0xa0b1f1e3b4b2ba88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2ba8f expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788638649.599961:0:15795:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c73bf0eb800 from 1 10000000:01000000:0.0:1788638649.599964:0:15795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788638649.600033:0:15795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73b5467a00/0xa0b1f1e3b4b2baa4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638649.600043:0:15795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73b5467a00/0xa0b1f1e3b4b2baa4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638649.600058:0:15795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73b5467a00/0xa0b1f1e3b4b2baa4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638649.600093:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183674880:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788638649.604697:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638649.604771:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7393d946c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638649.606179:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183674880 00000100:00100000:1.0:1788638649.606196:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183674880 00000100:00100000:1.0:1788638649.606272:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788638649.606294:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+17:15795:x1875523183674880:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788638649.606311:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638649.606463:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7385308400/0xa0b1f1e3b4b2baab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2baa4 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638649.606494:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7385308400/0xa0b1f1e3b4b2baab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2baa4 expref: 18 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638649.606507:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7385308400/0xa0b1f1e3b4b2baab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2baa4 expref: 18 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638649.606828:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385308400, rc 0) 00000100:00100000:1.0:1788638649.606916:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+18:15795:x1875523183674880:12345-0@lo:101:mount.lustre.0 Request processed in 623us (2227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638649.606935:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788638649.607015:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61c380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183674880:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788638649.607046:0:15795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73b5467a00/0xa0b1f1e3b4b2baa4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2baab expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638649.607062:0:15795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73b5467a00/0xa0b1f1e3b4b2baa4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2baab expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788638649.616553:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788638649.617382:0:15795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788638649.617689:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788638649.617738:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788638649.617836:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788638649.617845:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788638649.617939:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183675008:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788638649.618028:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638649.618088:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73ad646840 going to sleep for 11 seconds 00000100:00100000:1.0:1788638649.618453:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183675008 00000100:00100000:1.0:1788638649.618464:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183675008 00000100:00100000:1.0:1788638649.618529:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788638649.618539:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+18:15795:x1875523183675008:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788638649.618839:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+18:15795:x1875523183675008:12345-0@lo:501:mount.lustre.0 Request processed in 300us (811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638649.618848:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788638649.619087:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183675008:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788638649.619133:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4666680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183675136:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788638649.619184:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638649.619217:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398770600 going to sleep for 11 seconds 00000100:00100000:1.0:1788638649.619302:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183675136 00000100:00100000:1.0:1788638649.619306:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183675136 00000100:00100000:1.0:1788638649.619339:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788638649.619346:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+18:15795:x1875523183675136:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788638649.619596:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+18:15795:x1875523183675136:12345-0@lo:503:mount.lustre.0 Request processed in 249us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638649.619613:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788638649.621149:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4666680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183675136:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788638649.623034:0:15795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788638649.623146:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4666680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183675264:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788638649.623942:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638649.624050:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398770600 going to sleep for 11 seconds 00000100:00100000:1.0:1788638649.625758:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183675264 00000100:00100000:1.0:1788638649.625775:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183675264 00000100:00100000:1.0:1788638649.626118:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788638649.626130:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+18:15795:x1875523183675264:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788638649.626880:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+18:15795:x1875523183675264:12345-0@lo:502:mount.lustre.0 Request processed in 750us (2937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638649.626892:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788638649.627035:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4666680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183675264:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788638649.627622:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788638649.627692:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788638649.627758:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788638649.627947:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788638649.627989:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788638649.628052:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788638649.628095:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788638649.628132:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788638649.628187:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183675392:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788638649.629130:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638649.629225:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73ad646840 going to sleep for 11 seconds 00000100:00100000:1.0:1788638649.630305:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183675392 00000100:00100000:1.0:1788638649.630318:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183675392 00000100:00100000:1.0:1788638649.630497:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788638649.630519:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bcddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+18:15795:x1875523183675392:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788638649.630879:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bcddf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+18:15795:x1875523183675392:12345-0@lo:502:mount.lustre.0 Request processed in 371us (1751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638649.630888:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788638649.631015:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183675392:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788638649.631548:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788638649.631580:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788638649.633112:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788638649.633126:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638649.633129:0:15800:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788638649.633137:0:15800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c73bf0eb800 00000020:00000080:3.0:1788638649.633140:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788638649.633160:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638649.633163:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638649.633164:0:15800:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788638649.633167:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788638649.633169:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638649.633171:0:15800:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788638649.633174:0:15800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9c73bf0eb800 00000020:00000080:3.0:1788638649.633177:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788638649.633259:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638649.633263:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638649.633264:0:15800:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788638649.633267:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788638649.633270:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638649.633271:0:15800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788638649.633274:0:15800:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9c73bf0eb800 00000020:00000080:3.0:1788638649.633276:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788638649.633315:0:15800:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788638649.633319:0:15800:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788638649.633321:0:15800:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788638649.633324:0:15800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788638649.634871:0:15795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788638649.634915:0:15795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788638649.636597:0:15795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73b5467a00/0xa0b1f1e3b4b2baa4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2baab expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638649.636628:0:15795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73b5467a00/0xa0b1f1e3b4b2baa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2baab expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788638649.636702:0:15795:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788638649.636705:0:15795:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9c73bf0eb800 10000000:01000000:1.0:1788638649.636709:0:15795:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9c73bf0eb800 10000000:01000000:1.0:1788638649.636714:0:15795:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788638649.636722:0:15795:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9c73bf0eb800 from 1 10000000:01000000:1.0:1788638649.636725:0:15795:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788638649.636773:0:15795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385308c00/0xa0b1f1e3b4b2bab2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638649.636798:0:15795:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7385308c00/0xa0b1f1e3b4b2bab2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638649.636811:0:15795:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7385308c00/0xa0b1f1e3b4b2bab2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638649.636842:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183675520:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788638649.636933:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638649.636995:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183675520 00000100:00100000:1.0:1788638649.637004:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183675520 00000100:00100000:1.0:1788638649.637059:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788638649.637070:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bcdde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+18:15795:x1875523183675520:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788638649.637086:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638649.637104:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7385308000/0xa0b1f1e3b4b2bab9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2bab2 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638649.637148:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7385308000/0xa0b1f1e3b4b2bab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bab2 expref: 19 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638649.637160:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7385308000/0xa0b1f1e3b4b2bab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bab2 expref: 19 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638649.637170:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7385308000, rc 0) 00000100:00100000:1.0:1788638649.637209:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bcdde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:15795:x1875523183675520:12345-0@lo:101:mount.lustre.0 Request processed in 140us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638649.637217:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788638649.637270:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bbce0a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788638649.637296:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183675520:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788638649.637312:0:15795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7385308c00/0xa0b1f1e3b4b2bab2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bab9 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638649.637323:0:15795:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7385308c00/0xa0b1f1e3b4b2bab2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2bab9 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788638649.638085:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788638649.638432:0:15795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788638649.638714:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788638649.638761:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788638649.638827:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788638649.638878:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788638649.638917:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788638649.638969:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788638649.639006:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788638649.639039:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788638649.639099:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788638649.639135:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788638649.639166:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788638649.639226:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788638649.639264:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788638649.639298:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788638649.639346:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788638649.639382:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788638649.639435:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788638649.639485:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788638649.639520:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788638649.639554:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788638649.639601:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788638649.648465:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788638649.648553:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788638649.648665:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788638649.648702:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788638649.648737:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788638649.648813:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788638649.648853:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788638649.648888:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788638649.648940:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1788638649.648977:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1788638649.649009:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1788638649.649071:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1788638649.649123:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1788638649.649159:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1788638649.649341:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1788638649.649386:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1788638649.649500:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1788638649.649508:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788638649.650186:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183675648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788638649.650364:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638649.650422:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bbce0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788638649.652344:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183675648 00000100:00100000:2.0:1788638649.652364:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183675648 00000100:00100000:2.0:1788638649.652437:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788638649.652448:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bcddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:15795:x1875523183675648:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788638649.652883:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bcddfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:15795:x1875523183675648:12345-0@lo:501:mount.lustre.0 Request processed in 434us (2517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638649.652892:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788638649.653690:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183675648:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788638649.653755:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183675776:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788638649.653862:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638649.653910:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bbce0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788638649.654317:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183675776 00000100:00100000:2.0:1788638649.654325:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183675776 00000100:00100000:2.0:1788638649.654367:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788638649.654377:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bcddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:15795:x1875523183675776:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788638649.655926:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bcddf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:15795:x1875523183675776:12345-0@lo:503:mount.lustre.0 Request processed in 1541us (2054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638649.655940:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788638649.656145:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183675776:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788638649.657076:0:15795:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788638649.657199:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183675904:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788638649.660945:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638649.660997:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183675904 00000100:00100000:1.0:1788638649.661007:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183675904 00000100:00100000:1.0:1788638649.661066:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788638649.661078:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bcddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:15795:x1875523183675904:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788638649.661492:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bcddd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:15795:x1875523183675904:12345-0@lo:502:mount.lustre.0 Request processed in 416us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638649.661501:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788638649.662293:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73c0a3ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788638649.662328:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183675904:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788638649.663399:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788638649.663483:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788638649.663516:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788638649.664364:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788638649.664430:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788638649.664499:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788638649.664538:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788638649.665358:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788638649.665422:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788638649.665453:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788638649.665482:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788638649.666925:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788638649.667018:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788638649.667055:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788638649.667127:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788638649.667168:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788638649.668313:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788638649.668415:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788638649.668456:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788638649.668493:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788638649.668547:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788638649.669343:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788638649.669390:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788638649.669471:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788638649.669511:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788638649.669549:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788638649.670502:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788638649.670547:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788638649.670670:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788638649.670725:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788638649.670762:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788638649.671447:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788638649.671497:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788638649.671558:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788638649.671622:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788638649.671680:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788638649.671718:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788638649.671756:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788638649.671858:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788638649.671916:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788638649.671993:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183676032:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788638649.672093:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638649.672149:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73c0a3ce40 going to sleep for 11 seconds 00000100:00100000:2.0:1788638649.673395:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183676032 00000100:00100000:2.0:1788638649.673415:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183676032 00000100:00100000:2.0:1788638649.673482:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788638649.673494:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:15795:x1875523183676032:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788638649.673866:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:15795:x1875523183676032:12345-0@lo:502:mount.lustre.0 Request processed in 373us (1771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638649.673876:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788638649.674737:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183676032:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788638649.674895:0:15795:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1788638649.674912:0:15795:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788638649.677480:0:15804:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788638649.677505:0:15804:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9c73bce3cd40) 00000020:00000080:0.0:1788638649.677536:0:15804:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1788638649.678727:0:15804:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9c73bf0eb800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788638649.678736:0:15804:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9c73bf0eb800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788638649.678739:0:15804:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9c73bf0eb800 3 00010000:00080000:0.0:1788638649.678923:0:15804:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9c73b576a800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.134@tcp at head 00010000:00010000:0.0:1788638649.684082:0:15804:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1788638649.687055:0:15804:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788638649.687121:0:15804:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788638649.687140:0:15804:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa0b1f1e3b4b2bac7 00000100:00080000:0.0:1788638649.687154:0:15804:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788638649.687163:0:15804:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9c73b576a800 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:0.0:1788638649.687209:0:15804:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73bf61d880 x1875523183676160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788638649.687255:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1875523183676160:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788638649.687348:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788638649.687427:0:15804:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788638649.687453:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788638649.687458:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788638649.687460:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c73bce59800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788638649.687466:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 411 00000100:00080000:0.0:1788638649.687471:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788638649.687475:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c73bce59800 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:0.0:1788638649.687493:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73bf61c380 x1875523183676288/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788638649.687555:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183676416:0@lo:400:kworker.0 00000100:00100000:0.0:1788638649.687585:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638649.687815:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183676160 00000100:00100000:3.0:1788638649.687824:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183676160 00000100:00100000:3.0:1788638649.687857:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183676416 00000100:00100000:3.0:1788638649.687861:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183676416 00000100:00100000:3.0:1788638649.687889:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788638649.687900:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183676416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638649.687960:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183676416:12345-0@lo:400:kworker.0 Request processed in 61us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638649.687968:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788638649.687986:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788638649.687990:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3290:x1875523183676160:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788638649.688015:0:14396:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 412 last 0 00000020:00000080:3.0:1788638649.688061:0:14396:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa0b1f1e3b4b2bace 00000004:00100000:3.0:1788638649.688079:0:14396:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788638649.688119:0:14396:0:(import.c:65:import_set_state_nolock()) ffff9c73acdc7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788638649.688156:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3290:x1875523183676160:12345-0@lo:38:llog_process_th.0 Request processed in 164us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638649.688163:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788638649.688183:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788638649.688192:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183676544:0@lo:400:kworker.0 00000100:00100000:3.0:1788638649.688236:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638649.688264:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183676544 00000100:00100000:3.0:1788638649.688267:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183676544 00000100:00100000:3.0:1788638649.688299:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788638649.688305:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183676544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638649.688337:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183676544:12345-0@lo:400:kworker.0 Request processed in 31us (100us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638649.688342:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788638649.688361:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788638649.688391:0:3292:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73bf61e680 x1875523183676544/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638649.688406:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183676544:0@lo:400:kworker.0 00000100:00100000:3.0:1788638649.689413:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183676288:0@lo:8:kworker.0 00000100:00100000:3.0:1788638649.689472:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788638649.689522:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73bf61d880 x1875523183676160/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788638659 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638649.689534:0:3290:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788638649.689543:0:3290:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788638649.689573:0:3290:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788638649.689579:0:3290:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788638649.689583:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73b576a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788638649.689590:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3290:1875523183676160:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788638649.689645:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183676288 00000100:00100000:3.0:1788638649.689651:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183676288 00000100:00100000:3.0:1788638649.689685:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788638649.689693:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3290:x1875523183676288:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1788638649.689746:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4664a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3290:x1875523183676288:12345-0@lo:8:kworker.0 Request processed in 52us (272us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788638649.689753:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788638649.689779:0:3290:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788638649.689802:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73bce59800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788638649.689806:0:3290:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788638649.689809:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183676288:0@lo:8:kworker.0 00010000:00080000:0.0:1788638649.690328:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9c73bf61c700 x1875523183676416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638665 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638649.690341:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183676416:0@lo:400:kworker.0 00000040:00080000:0.0:1788638649.691093:0:15804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788638649.691388:0:15795:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788638649.691422:0:15795:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788638649.691449:0:15795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7385308c00/0xa0b1f1e3b4b2bab2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bab9 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638649.691462:0:15795:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7385308c00/0xa0b1f1e3b4b2bab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bab9 expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788638649.691516:0:15795:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788638649.691519:0:15795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788638649.691521:0:15795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638649.691522:0:15795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638649.691523:0:15795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638649.691525:0:15795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638649.691526:0:15795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788638649.691529:0:15795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638649.691530:0:15795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788638649.691536:0:15795:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788638649.691539:0:15795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788638649.691540:0:15795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788638649.691541:0:15795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638649.691542:0:15795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638649.691544:0:15795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638649.691545:0:15795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638649.691546:0:15795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788638649.691547:0:15795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638649.691548:0:15795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788638649.691586:0:15795:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788638649.691621:0:15795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183676672:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788638649.691695:0:15795:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638649.691723:0:15795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73c0a3ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788638649.691753:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183676672 00000100:00100000:1.0:1788638649.691760:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183676672 00000100:00100000:1.0:1788638649.691830:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788638649.691840:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:15795:x1875523183676672:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788638649.691873:0:14389:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788638649.691890:0:14389:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788638649.727397:0:14389:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788638649.727414:0:14389:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788638649.727686:0:14411:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788638649.727693:0:14411:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788638649.727721:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c7399aa7000/0xa0b1f1e3b4b2bad5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638649.727745:0:14411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c73bc01d800/0xa0b1f1e3b4b2b9a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b9a1 expref: 19 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638649.727755:0:14411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c7399aa7000/0xa0b1f1e3b4b2bad5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638649.727843:0:14411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c73bc01d800/0xa0b1f1e3b4b2b9a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b9a1 expref: 19 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638649.727861:0:14411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c73bc01d800/0xa0b1f1e3b4b2b9a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b9a1 expref: 19 pid: 14389 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638649.727880:0:14411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14411:1875523183676800:0@lo:104: 00000100:00100000:2.0:1788638649.727965:0:14411:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638649.728015:0:14411:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c72826ce780 going to sleep for 11 seconds 00000100:00100000:2.0:1788638649.728049:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183676800 00000100:00100000:2.0:1788638649.728058:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183676800 00000100:00100000:2.0:1788638649.728109:0:14378:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788638649.728118:0:14378:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385379c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+3:14411:x1875523183676800:12345-0@lo:104: 00010000:00010000:2.0:1788638649.728149:0:14378:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2b9a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2b9a8 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638649.728204:0:14378:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788638649.728210:0:14378:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385379c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+3:14411:x1875523183676800:12345-0@lo:104: Request processed in 93us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638649.728217:0:14378:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788638649.728256:0:14411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14411:1875523183676800:0@lo:104: 00010000:00010000:2.0:1788638649.728277:0:14411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c7399aa7000/0xa0b1f1e3b4b2bad5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638649.728296:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638649.728302:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2b9a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2b9a8 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638649.728309:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380030a00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:2.0:1788638649.728314:0:14383:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2b9a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2b9a8 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638649.728324:0:14383:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2b9a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2b9a8 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788638649.728332:0:14383:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2b9a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2b9a8 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638649.728338:0:14383:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788638649.728367:0:14383:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2b9a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2b9a8 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638649.728374:0:14383:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788638649.728400:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2b9a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2b9a8 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638649.728408:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7380030a00/0xa0b1f1e3b4b2b9a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2b9a8 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638649.728424:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638649.728425:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638649.728427:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638649.728434:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788638649.728445:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183676928:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788638649.728473:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638649.729908:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183676928 00000100:00100000:0.0:1788638649.729920:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183676928 00010000:00010000:0.0:1788638649.729956:0:14382:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c73bc01d800/0xa0b1f1e3b4b2b9a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b9a1 expref: 20 pid: 14389 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638649.729995:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788638649.730004:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+20:3291:x1875523183676928:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788638649.730018:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638649.730023:0:14382:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c73bc01d800/0xa0b1f1e3b4b2b9a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b9a1 expref: 20 pid: 14389 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638649.730052:0:14382:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c73bc01d800/0xa0b1f1e3b4b2b9a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b9a1 expref: 20 pid: 14389 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638649.730071:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73bc01d800/0xa0b1f1e3b4b2b9a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b9a1 expref: 20 pid: 14389 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638649.730089:0:14382:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c7399aa7000/0xa0b1f1e3b4b2bad5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638649.730099:0:14382:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7399aa7000/0xa0b1f1e3b4b2bad5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788638649.730117:0:14382:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002425243s 00010000:00010000:0.0:1788638649.730121:0:14382:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7399aa7000/0xa0b1f1e3b4b2bad5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638649.730130:0:14382:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c7399aa7000/0xa0b1f1e3b4b2bad5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638649.730138:0:14382:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c7399aa7000/0xa0b1f1e3b4b2bad5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638649.730145:0:14382:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c7399aa7000/0xa0b1f1e3b4b2bad5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638649.730151:0:14382:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638649.730156:0:14382:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c7399aa7000/0xa0b1f1e3b4b2bad5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638649.730165:0:14382:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c7399aa7000/0xa0b1f1e3b4b2bad5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638649.730185:0:14382:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c7399aa7000/0xa0b1f1e3b4b2bad5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638649.730195:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638649.730262:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3291:x1875523183676928:12345-0@lo:103:ldlm_bl.0 Request processed in 258us (1787us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638649.730269:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788638649.730381:0:14411:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c7399aa7000/0xa0b1f1e3b4b2bad5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638649.730390:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c7399aa7000/0xa0b1f1e3b4b2bad5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638649.730396:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7399aa7000/0xa0b1f1e3b4b2bad5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638649.730436:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183676928:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788638649.736040:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+18:15795:x1875523183676672:12345-0@lo:253:mount.lustre.0 Request processed in 44188us (44331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638649.736059:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788638649.736186:0:15795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d97ff07e-b3b5-4ef8-bed3-2a6960653930:15795:1875523183676672:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788638649.736216:0:15795:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788638649.736220:0:15795:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788638649.736222:0:15795:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788638649.736224:0:15795:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788638649.736225:0:15795:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788638649.736227:0:15795:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788638649.736228:0:15795:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788638649.736230:0:15795:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788638649.736232:0:15795:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788638649.736233:0:15795:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788638649.736255:0:15795:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788638649.742465:0:15795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788638649.742678:0:15795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788638649.742887:0:15795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788638649.743050:0:15795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788638649.743206:0:15795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788638649.743435:0:15795:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788638649.745117:0:15795:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788638649.836998:0:15795:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788638649.837011:0:15795:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788638649.837069:0:15795:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788638649.837142:0:15795:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.134@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788638649.837159:0:15795:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788638649.837193:0:15795:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788638650.400389:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638651.430408:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788638651.683141:0:14391:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788638651.683153:0:14391:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9c73908d2000 from 8 10000000:01000000:0.0:1788638651.683159:0:14391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788638651.683241:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73b5467800/0xa0b1f1e3b4b2badc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638651.683256:0:14391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c73b5467800/0xa0b1f1e3b4b2badc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638651.683269:0:14391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c73b5467800/0xa0b1f1e3b4b2badc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638651.683302:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183677056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788638651.683398:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638651.683465:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738802a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788638651.683764:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183677056 00000100:00100000:2.0:1788638651.683777:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183677056 00000100:00100000:2.0:1788638651.683871:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788638651.683883:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+18:14391:x1875523183677056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788638651.683901:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638651.683933:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7399aa7600/0xa0b1f1e3b4b2bae3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2badc expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638651.683963:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7399aa7600/0xa0b1f1e3b4b2bae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2badc expref: 19 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638651.683976:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7399aa7600/0xa0b1f1e3b4b2bae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2badc expref: 19 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638651.683988:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7600, rc 0) 00000100:00100000:2.0:1788638651.684046:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:14391:x1875523183677056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638651.684053:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788638651.685927:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183677056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788638651.685966:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c73b5467800/0xa0b1f1e3b4b2badc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bae3 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638651.685981:0:14391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c73b5467800/0xa0b1f1e3b4b2badc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2bae3 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638651.686084:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183677184:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788638651.686166:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638651.686230:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738a4bb780 going to sleep for 11 seconds 00000100:00100000:2.0:1788638651.686312:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183677184 00000100:00100000:2.0:1788638651.686321:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183677184 00000100:00100000:2.0:1788638651.686381:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788638651.686392:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:14391:x1875523183677184:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788638651.686416:0:14389:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788638651.686437:0:14389:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788638651.686441:0:14389:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788638651.686541:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:14391:x1875523183677184:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 149us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638651.686561:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788638651.687535:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183677184:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788638651.687644:0:14391:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788638651.687656:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c73b5467800/0xa0b1f1e3b4b2badc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bae3 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638651.687668:0:14391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c73b5467800/0xa0b1f1e3b4b2badc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bae3 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788638652.264023:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1788638652.264101:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788638652.448677:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638653.472124:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638654.176696:0:3294:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788638654.176732:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183677312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788638654.176851:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638654.176953:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183677312 00000100:00100000:3.0:1788638654.176963:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183677312 00000100:00100000:3.0:1788638654.177047:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788638654.177062:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183677312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788638654.177111:0:15080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788638654.177192:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4666a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183677312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638654.177201:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788638654.177234:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788638654.177286:0:3294:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788638654.179713:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183677312:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788638654.501076:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788638654.687958:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788638654.687967:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788638654.687971:0:36:0:(import.c:65:import_set_state_nolock()) ffff9c73bce59800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788638654.687986:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9c73bce59800 using connection 192.168.203.134@tcp/0@lo 00000100:00100000:0.0:1788638654.688024:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9c73bf61ed80 x1875523183677568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788638654.688143:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183677952:0@lo:400:kworker.0 00000100:00100000:0.0:1788638654.688230:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638654.688298:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788638654.688305:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3293:1875523183677440:0@lo:400:kworker.0 00000100:00100000:0.0:1788638654.688342:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638654.688375:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183677696:0@lo:400:kworker.0 00000100:00100000:0.0:1788638654.688402:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638654.688422:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638654.688427:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183677824:0@lo:400:kworker.0 00000100:00100000:0.0:1788638654.688448:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638654.688832:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183677440 00000100:00100000:1.0:1788638654.688843:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183677440 00000100:00100000:1.0:1788638654.688903:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788638654.688914:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3293:x1875523183677440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638654.688976:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3293:x1875523183677440:12345-0@lo:400:kworker.0 Request processed in 64us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638654.688995:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788638654.689056:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3293:1875523183677440:0@lo:400:kworker.0 00000100:00100000:3.0:1788638654.689451:0:3290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73bf61ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183677568:0@lo:8:kworker.0 00000100:00100000:3.0:1788638654.689490:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638654.689550:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183677952 00000100:00100000:3.0:1788638654.689555:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183677952 00000100:00100000:3.0:1788638654.689616:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183677696 00000100:00100000:3.0:1788638654.689619:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183677696 00000100:00100000:3.0:1788638654.689632:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183677824 00000100:00100000:3.0:1788638654.689634:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183677824 00000100:00100000:3.0:1788638654.689647:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788638654.689654:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183677952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638654.689693:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183677952:12345-0@lo:400:kworker.0 Request processed in 40us (1465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638654.689700:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788638654.689713:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788638654.689719:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183677696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638654.689752:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183677696:12345-0@lo:400:kworker.0 Request processed in 33us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638654.689758:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788638654.689769:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788638654.689810:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183677824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638654.689840:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183677824:12345-0@lo:400:kworker.0 Request processed in 65us (1390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638654.689855:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1788638654.689896:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788638654.689922:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73bf61ea00 x1875523183677824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638654.689936:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183677824:0@lo:400:kworker.0 00010000:00080000:3.0:1788638654.689948:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73bf61f800 x1875523183677696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638654.689956:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183677696:0@lo:400:kworker.0 00000100:00100000:1.0:1788638654.690711:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183677568 00000100:00100000:1.0:1788638654.690720:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183677568 00000100:00100000:1.0:1788638654.690754:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788638654.690761:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3290:x1875523183677568:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788638654.690823:0:15079:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 417 last 0 00000020:00000080:1.0:1788638654.690860:0:15079:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa0b1f1e3b4b2baea 00002000:00100000:1.0:1788638654.690878:0:15079:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9c728301b000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a03 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788638654.690883:0:15079:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788638654.690887:0:15079:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788638654.691287:0:15079:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788638654.691318:0:15079:0:(import.c:65:import_set_state_nolock()) ffff9c7283018800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788638654.691394:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4666d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3290:x1875523183677568:12345-0@lo:8:kworker.0 Request processed in 631us (1902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638654.691402:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788638654.691462:0:3290:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73bf61ed80 x1875523183677568/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788638679 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788638654.691480:0:3290:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788638654.691489:0:3290:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788638654.691496:0:3290:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788638654.691498:0:3290:0:(import.c:65:import_set_state_nolock()) ffff9c73bce59800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788638654.691515:0:3290:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788638654.691521:0:3290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3290:1875523183677568:0@lo:8:kworker.0 00000004:00080000:1.0:1788638654.691592:0:14420:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1788638654.698157:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d07b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14420:1875523183678208:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788638654.698248:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638654.698289:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73ad646240 going to sleep for 11 seconds 00000004:00080000:1.0:1788638654.698321:0:14419:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788638654.698929:0:14419:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 417770144250ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788638654.698974:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183678208 00000100:00100000:1.0:1788638654.698983:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183678208 00000100:00100000:1.0:1788638654.699068:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788638654.699079:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14420:x1875523183678208:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:3.0:1788638654.705549:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788638654.706494:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183678080:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788638654.706744:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788638654.707013:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73bf61c700 x1875523183677952/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638654.707033:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73bf61c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183677952:0@lo:400:kworker.0 00000100:00100000:0.0:1788638654.707226:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183678080 00000100:00100000:0.0:1788638654.707236:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183678080 00000100:00100000:0.0:1788638654.707305:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788638654.707317:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1875523183678080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788638654.707366:0:15080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788638654.707426:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4666680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3294:x1875523183678080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638654.707434:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788638654.707472:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c73b7d07480 x1875523183678080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788638670 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638654.707490:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183678080:0@lo:13:osp-pre-1-0.0 00002000:00080000:1.0:1788638654.714582:0:15077:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788638654.714600:0:15077:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788638654.716050:0:15077:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:1.0:1788638654.739442:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.739457:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb54e1b/0xa0b1f1e3b4b2baf1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.739480:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.739485:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.739492:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000feb54e1b/0xa0b1f1e3b4b2baf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.739514:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000feb54e1b/0xa0b1f1e3b4b2baf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.739527:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000feb54e1b/0xa0b1f1e3b4b2baf1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.739550:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000feb54e1b/0xa0b1f1e3b4b2baf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.739586:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788638654.739605:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638654.739613:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000feb54e1b/0xa0b1f1e3b4b2baf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.739622:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308800 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638654.739627:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb54e1b/0xa0b1f1e3b4b2baf1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.739638:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000feb54e1b/0xa0b1f1e3b4b2baf1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.739660:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000feb54e1b/0xa0b1f1e3b4b2baf1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.739669:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000feb54e1b/0xa0b1f1e3b4b2baf1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.739692:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.739694:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.739697:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638654.740300:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.740314:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2baf8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.740325:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.740330:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.740335:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2baf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.740347:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2baf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.740355:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2baf8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.740364:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2baf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.740381:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788638654.740393:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638654.740397:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2baf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.740403:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309e00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638654.740407:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2baf8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.740415:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2baf8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.740436:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2baf8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.740444:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000068c31f40/0xa0b1f1e3b4b2baf8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.740459:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.740460:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.740462:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638654.741030:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.741038:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063c84e6c/0xa0b1f1e3b4b2baff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.741047:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.741051:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.741056:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000063c84e6c/0xa0b1f1e3b4b2baff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.741068:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000063c84e6c/0xa0b1f1e3b4b2baff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.741077:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000063c84e6c/0xa0b1f1e3b4b2baff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.741086:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000063c84e6c/0xa0b1f1e3b4b2baff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.741120:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788638654.742157:0:15767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638654.742169:0:15767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000063c84e6c/0xa0b1f1e3b4b2baff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.742196:0:15767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308600 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638654.742201:0:15767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000063c84e6c/0xa0b1f1e3b4b2baff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.742212:0:15767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000063c84e6c/0xa0b1f1e3b4b2baff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.742236:0:15767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000063c84e6c/0xa0b1f1e3b4b2baff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.742245:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000063c84e6c/0xa0b1f1e3b4b2baff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.742267:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638654.742270:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638654.742271:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638654.744934:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.744952:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034f5e9b2/0xa0b1f1e3b4b2bb06 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.744972:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.744978:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.744985:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000034f5e9b2/0xa0b1f1e3b4b2bb06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.745002:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000034f5e9b2/0xa0b1f1e3b4b2bb06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.745013:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000034f5e9b2/0xa0b1f1e3b4b2bb06 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.745022:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000034f5e9b2/0xa0b1f1e3b4b2bb06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.745051:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788638654.745856:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638654.745868:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000034f5e9b2/0xa0b1f1e3b4b2bb06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.745882:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309200 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638654.745889:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000034f5e9b2/0xa0b1f1e3b4b2bb06 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.745901:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000034f5e9b2/0xa0b1f1e3b4b2bb06 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.745935:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000034f5e9b2/0xa0b1f1e3b4b2bb06 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.745943:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000034f5e9b2/0xa0b1f1e3b4b2bb06 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.745968:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638654.745971:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638654.745973:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638654.746154:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.746161:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000533f0374/0xa0b1f1e3b4b2bb0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.746172:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.746183:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.746979:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000533f0374/0xa0b1f1e3b4b2bb0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.747187:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000533f0374/0xa0b1f1e3b4b2bb0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.747202:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000533f0374/0xa0b1f1e3b4b2bb0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.747213:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000533f0374/0xa0b1f1e3b4b2bb0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.747236:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788638654.747253:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638654.747259:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000533f0374/0xa0b1f1e3b4b2bb0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.747269:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308e00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638654.747274:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000533f0374/0xa0b1f1e3b4b2bb0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.747284:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000533f0374/0xa0b1f1e3b4b2bb0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.747300:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000533f0374/0xa0b1f1e3b4b2bb0d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.747323:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000533f0374/0xa0b1f1e3b4b2bb0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.747346:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.747349:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.747351:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638654.748955:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.748969:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2bb14 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.748986:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.748990:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.749069:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2bb14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.749088:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2bb14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.749100:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2bb14 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.749109:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2bb14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.749130:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788638654.754475:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.754499:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2bb1b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.754520:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.754526:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.754543:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2bb1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.754561:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2bb1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.754582:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2bb1b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.754590:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2bb1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.754633:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788638654.755155:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.755162:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2bb22 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.755173:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.755176:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.755181:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2bb22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.755193:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2bb22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.755210:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2bb22 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.755218:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2bb22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.755237:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788638654.755257:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788638654.755264:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2bb14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.755273:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309c00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638654.755278:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2bb14 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.755289:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2bb14 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.755309:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2bb14 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.755317:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eefa7611/0xa0b1f1e3b4b2bb14 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.755338:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788638654.755349:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2bb1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.755355:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309400 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638654.755358:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2bb1b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.755367:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2bb1b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.755377:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2bb1b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.755385:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000018375fc5/0xa0b1f1e3b4b2bb1b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.755399:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638654.755402:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2bb22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.755409:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385309800 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638654.755412:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2bb22 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.755419:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2bb22 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.755441:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2bb22 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.755467:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007aa16e74/0xa0b1f1e3b4b2bb22 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.755483:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.755485:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.755487:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638654.756166:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.756174:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083543c23/0xa0b1f1e3b4b2bb29 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.756186:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.756189:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.756195:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083543c23/0xa0b1f1e3b4b2bb29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.756206:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083543c23/0xa0b1f1e3b4b2bb29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.756217:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083543c23/0xa0b1f1e3b4b2bb29 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.756226:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083543c23/0xa0b1f1e3b4b2bb29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.756254:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788638654.756264:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638654.756268:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083543c23/0xa0b1f1e3b4b2bb29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.756276:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308200 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638654.756280:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083543c23/0xa0b1f1e3b4b2bb29 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.756289:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083543c23/0xa0b1f1e3b4b2bb29 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.756301:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083543c23/0xa0b1f1e3b4b2bb29 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.756310:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083543c23/0xa0b1f1e3b4b2bb29 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.756327:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.756329:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.756331:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638654.756762:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.756768:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2bb30 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.756778:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.756813:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.756818:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2bb30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.756830:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2bb30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.756839:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2bb30 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.756848:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2bb30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.756861:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788638654.756870:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638654.756874:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2bb30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.756881:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7385308a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638654.756885:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2bb30 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.756893:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2bb30 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.756904:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2bb30 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.756922:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fa2cfa9/0xa0b1f1e3b4b2bb30 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.756937:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.756939:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.756940:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638654.757351:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.757357:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000902bb5a2/0xa0b1f1e3b4b2bb37 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.757367:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.757370:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.757374:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000902bb5a2/0xa0b1f1e3b4b2bb37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.757385:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000902bb5a2/0xa0b1f1e3b4b2bb37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.757394:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000902bb5a2/0xa0b1f1e3b4b2bb37 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.757401:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000902bb5a2/0xa0b1f1e3b4b2bb37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.757417:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788638654.757426:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638654.757435:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000902bb5a2/0xa0b1f1e3b4b2bb37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.757443:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5569c00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638654.757447:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000902bb5a2/0xa0b1f1e3b4b2bb37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.757456:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000902bb5a2/0xa0b1f1e3b4b2bb37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.757468:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000902bb5a2/0xa0b1f1e3b4b2bb37 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.757476:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000902bb5a2/0xa0b1f1e3b4b2bb37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.757490:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.757492:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.757494:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638654.760707:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638654.760718:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638654.761101:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.761113:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009aa1ad7d/0xa0b1f1e3b4b2bb3e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.761133:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.761139:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.761147:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009aa1ad7d/0xa0b1f1e3b4b2bb3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.761179:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009aa1ad7d/0xa0b1f1e3b4b2bb3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.761191:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009aa1ad7d/0xa0b1f1e3b4b2bb3e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.761199:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009aa1ad7d/0xa0b1f1e3b4b2bb3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.761220:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788638654.761233:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638654.761239:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009aa1ad7d/0xa0b1f1e3b4b2bb3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.761247:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5569e00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638654.761252:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009aa1ad7d/0xa0b1f1e3b4b2bb3e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.761261:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009aa1ad7d/0xa0b1f1e3b4b2bb3e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.761280:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009aa1ad7d/0xa0b1f1e3b4b2bb3e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.761289:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009aa1ad7d/0xa0b1f1e3b4b2bb3e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.761321:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.761323:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.761325:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638654.762844:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.762857:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca724411/0xa0b1f1e3b4b2bb45 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.762875:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.762879:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.762885:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca724411/0xa0b1f1e3b4b2bb45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.762899:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca724411/0xa0b1f1e3b4b2bb45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.762909:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca724411/0xa0b1f1e3b4b2bb45 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.762918:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca724411/0xa0b1f1e3b4b2bb45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.762950:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788638654.764013:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.764023:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2bb4c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.764048:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.764052:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.764058:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2bb4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.764071:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2bb4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.764081:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2bb4c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.764088:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2bb4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.764117:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788638654.764139:0:15767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788638654.764147:0:15767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca724411/0xa0b1f1e3b4b2bb45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.764154:0:15767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5568a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638654.764160:0:15767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca724411/0xa0b1f1e3b4b2bb45 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.764169:0:15767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca724411/0xa0b1f1e3b4b2bb45 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.764199:0:15767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca724411/0xa0b1f1e3b4b2bb45 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.764208:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca724411/0xa0b1f1e3b4b2bb45 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.764232:0:15767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638654.764236:0:15767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2bb4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.764243:0:15767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5569000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638654.764246:0:15767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2bb4c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.764253:0:15767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2bb4c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.764262:0:15767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2bb4c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.764270:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2bb4c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.764284:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.764286:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.764294:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638654.765286:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.765296:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028211d06/0xa0b1f1e3b4b2bb53 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.765310:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.765315:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.765320:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000028211d06/0xa0b1f1e3b4b2bb53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.765333:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000028211d06/0xa0b1f1e3b4b2bb53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.765345:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000028211d06/0xa0b1f1e3b4b2bb53 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.765354:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000028211d06/0xa0b1f1e3b4b2bb53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.765376:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788638654.765389:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638654.765395:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000028211d06/0xa0b1f1e3b4b2bb53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.765403:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5568e00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638654.765408:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000028211d06/0xa0b1f1e3b4b2bb53 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.765431:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000028211d06/0xa0b1f1e3b4b2bb53 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.765883:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.766236:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000028211d06/0xa0b1f1e3b4b2bb53 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.766251:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000028211d06/0xa0b1f1e3b4b2bb53 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.766275:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.766277:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.766280:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638654.767965:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.767980:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a940406/0xa0b1f1e3b4b2bb5a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.768258:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.768265:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.768273:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a940406/0xa0b1f1e3b4b2bb5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.768291:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a940406/0xa0b1f1e3b4b2bb5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.768303:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a940406/0xa0b1f1e3b4b2bb5a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.768322:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a940406/0xa0b1f1e3b4b2bb5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.768347:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638654.768772:0:15767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638654.768821:0:15767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a940406/0xa0b1f1e3b4b2bb5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.768840:0:15767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5569200 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638654.768845:0:15767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a940406/0xa0b1f1e3b4b2bb5a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.768857:0:15767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a940406/0xa0b1f1e3b4b2bb5a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.768881:0:15767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a940406/0xa0b1f1e3b4b2bb5a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.768889:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a940406/0xa0b1f1e3b4b2bb5a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.768917:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638654.768920:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638654.768922:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638654.769124:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.769132:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdcde9ee/0xa0b1f1e3b4b2bb61 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.769143:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.769147:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.769152:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cdcde9ee/0xa0b1f1e3b4b2bb61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.769164:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cdcde9ee/0xa0b1f1e3b4b2bb61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.769174:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cdcde9ee/0xa0b1f1e3b4b2bb61 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.769182:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cdcde9ee/0xa0b1f1e3b4b2bb61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.769206:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788638654.774414:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638654.774434:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cdcde9ee/0xa0b1f1e3b4b2bb61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.774451:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5569a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638654.774457:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdcde9ee/0xa0b1f1e3b4b2bb61 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.774473:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cdcde9ee/0xa0b1f1e3b4b2bb61 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.774500:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cdcde9ee/0xa0b1f1e3b4b2bb61 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.774510:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cdcde9ee/0xa0b1f1e3b4b2bb61 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.774552:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638654.774554:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638654.774556:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638654.779303:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.779325:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ee827a9/0xa0b1f1e3b4b2bb68 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.779359:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.779364:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.779373:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ee827a9/0xa0b1f1e3b4b2bb68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.779391:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ee827a9/0xa0b1f1e3b4b2bb68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.779404:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ee827a9/0xa0b1f1e3b4b2bb68 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.779414:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ee827a9/0xa0b1f1e3b4b2bb68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.779444:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638654.779589:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638654.779600:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ee827a9/0xa0b1f1e3b4b2bb68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.780046:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5568600 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638654.780053:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ee827a9/0xa0b1f1e3b4b2bb68 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.780065:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ee827a9/0xa0b1f1e3b4b2bb68 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.780096:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ee827a9/0xa0b1f1e3b4b2bb68 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.780105:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ee827a9/0xa0b1f1e3b4b2bb68 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.780129:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638654.780131:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638654.780134:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638654.783647:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.783662:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c9aa3c8/0xa0b1f1e3b4b2bb6f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.784279:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.784286:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.784295:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c9aa3c8/0xa0b1f1e3b4b2bb6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.784314:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c9aa3c8/0xa0b1f1e3b4b2bb6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.784344:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c9aa3c8/0xa0b1f1e3b4b2bb6f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.784353:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c9aa3c8/0xa0b1f1e3b4b2bb6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.784383:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638654.784496:0:15767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638654.784506:0:15767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c9aa3c8/0xa0b1f1e3b4b2bb6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.784517:0:15767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5569800 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638654.784523:0:15767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c9aa3c8/0xa0b1f1e3b4b2bb6f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.784534:0:15767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c9aa3c8/0xa0b1f1e3b4b2bb6f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.784556:0:15767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c9aa3c8/0xa0b1f1e3b4b2bb6f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.784567:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c9aa3c8/0xa0b1f1e3b4b2bb6f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.784642:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638654.784644:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638654.784646:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638654.786100:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.786115:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062cf1de0/0xa0b1f1e3b4b2bb76 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.786397:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.786402:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.786409:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062cf1de0/0xa0b1f1e3b4b2bb76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.786425:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062cf1de0/0xa0b1f1e3b4b2bb76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.786437:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062cf1de0/0xa0b1f1e3b4b2bb76 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.786526:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062cf1de0/0xa0b1f1e3b4b2bb76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.786746:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788638654.787119:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638654.787128:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062cf1de0/0xa0b1f1e3b4b2bb76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.787137:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5568200 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638654.787153:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062cf1de0/0xa0b1f1e3b4b2bb76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.787165:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062cf1de0/0xa0b1f1e3b4b2bb76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.787186:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062cf1de0/0xa0b1f1e3b4b2bb76 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.787195:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062cf1de0/0xa0b1f1e3b4b2bb76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.787220:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638654.787222:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638654.787224:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638654.788765:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.788778:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb840c48/0xa0b1f1e3b4b2bb7d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.788831:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.788836:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.788844:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb840c48/0xa0b1f1e3b4b2bb7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.788970:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb840c48/0xa0b1f1e3b4b2bb7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.788984:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb840c48/0xa0b1f1e3b4b2bb7d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.788992:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb840c48/0xa0b1f1e3b4b2bb7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.789028:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788638654.789381:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638654.789390:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb840c48/0xa0b1f1e3b4b2bb7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.789401:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5568400 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638654.789407:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb840c48/0xa0b1f1e3b4b2bb7d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.789417:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb840c48/0xa0b1f1e3b4b2bb7d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.789437:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb840c48/0xa0b1f1e3b4b2bb7d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.789446:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb840c48/0xa0b1f1e3b4b2bb7d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.789471:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638654.789474:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638654.789476:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638654.791079:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.791092:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2bb84 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.791110:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.791122:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.791128:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2bb84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.791768:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2bb84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.791811:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2bb84 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.791822:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2bb84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.791847:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788638654.792196:0:15767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638654.792206:0:15767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2bb84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.792228:0:15767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5568c00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638654.792234:0:15767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2bb84 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.792245:0:15767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2bb84 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.792266:0:15767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2bb84 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.792274:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2bb84 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.792296:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638654.792298:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638654.792300:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788638654.793336:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.793346:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ab4fdd5/0xa0b1f1e3b4b2bb8b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.793362:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.793367:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.793373:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ab4fdd5/0xa0b1f1e3b4b2bb8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.793386:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ab4fdd5/0xa0b1f1e3b4b2bb8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.793395:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ab4fdd5/0xa0b1f1e3b4b2bb8b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.793411:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ab4fdd5/0xa0b1f1e3b4b2bb8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.793538:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788638654.795218:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.795231:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c354b2ca/0xa0b1f1e3b4b2bb92 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.795248:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.795253:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.795259:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c354b2ca/0xa0b1f1e3b4b2bb92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.795274:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c354b2ca/0xa0b1f1e3b4b2bb92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.795286:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c354b2ca/0xa0b1f1e3b4b2bb92 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.795295:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c354b2ca/0xa0b1f1e3b4b2bb92 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788638654.799929:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:2.0:1788638654.802549:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788638654.802566:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ab4fdd5/0xa0b1f1e3b4b2bb8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.802596:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5569400 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638654.802602:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ab4fdd5/0xa0b1f1e3b4b2bb8b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.802615:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ab4fdd5/0xa0b1f1e3b4b2bb8b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.802667:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ab4fdd5/0xa0b1f1e3b4b2bb8b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.802676:0:14383:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ab4fdd5/0xa0b1f1e3b4b2bb8b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.802723:0:14383:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638654.802728:0:14383:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c354b2ca/0xa0b1f1e3b4b2bb92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.802734:0:14383:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5569600 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638654.802738:0:14383:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c354b2ca/0xa0b1f1e3b4b2bb92 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.802747:0:14383:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c354b2ca/0xa0b1f1e3b4b2bb92 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.802758:0:14383:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c354b2ca/0xa0b1f1e3b4b2bb92 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.802766:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638654.802768:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638654.802770:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.802980:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788638654.802991:0:15077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c354b2ca/0xa0b1f1e3b4b2bb92 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788638654.804373:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.804386:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f04624a9/0xa0b1f1e3b4b2bb99 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.804403:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.804408:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.804416:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f04624a9/0xa0b1f1e3b4b2bb99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.804433:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f04624a9/0xa0b1f1e3b4b2bb99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.804444:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f04624a9/0xa0b1f1e3b4b2bb99 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.804505:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f04624a9/0xa0b1f1e3b4b2bb99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.804558:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788638654.805361:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.805370:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056bc17dc/0xa0b1f1e3b4b2bba0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.805382:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.805386:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.805400:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056bc17dc/0xa0b1f1e3b4b2bba0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.805414:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056bc17dc/0xa0b1f1e3b4b2bba0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.805425:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056bc17dc/0xa0b1f1e3b4b2bba0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.805434:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056bc17dc/0xa0b1f1e3b4b2bba0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.813255:0:15767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788638654.813273:0:15767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f04624a9/0xa0b1f1e3b4b2bb99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.813316:0:15767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5568000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638654.813323:0:15767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f04624a9/0xa0b1f1e3b4b2bb99 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.813336:0:15767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f04624a9/0xa0b1f1e3b4b2bb99 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.813363:0:15767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f04624a9/0xa0b1f1e3b4b2bb99 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638654.813371:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f04624a9/0xa0b1f1e3b4b2bb99 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.813754:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788638654.813764:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056bc17dc/0xa0b1f1e3b4b2bba0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.819204:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5568800 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638654.819214:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056bc17dc/0xa0b1f1e3b4b2bba0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.819230:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056bc17dc/0xa0b1f1e3b4b2bba0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.819258:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056bc17dc/0xa0b1f1e3b4b2bba0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638654.819275:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638654.819277:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788638654.819280:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.819932:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788638654.819944:0:15077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056bc17dc/0xa0b1f1e3b4b2bba0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788638654.826860:0:15077:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788638654.826877:0:15077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2bba7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.826900:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=417s v=(0 0) 00010000:00010000:1.0:1788638654.826905:0:15077:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638654.826913:0:15077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2bba7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.826930:0:15077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2bba7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.826955:0:15077:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2bba7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.826964:0:15077:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2bba7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.826998:0:15077:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788638654.827019:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788638654.827026:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2bba7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.827035:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5569000 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638654.827040:0:14384:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2bba7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.827050:0:14384:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2bba7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.827070:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2bba7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.827078:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7681a88/0xa0b1f1e3b4b2bba7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638654.827103:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.827110:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788638654.827112:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788638654.827335:0:15077:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:1.0:1788638654.827471:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7d04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14420:x1875523183678208:12345-0@lo:5:osp-pre-1-0.0 Request processed in 128387us (129216us total) trans 0 rc 0/0 00010000:00010000:2.0:1788638654.827476:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638654.827479:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638654.827481:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638654.827485:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788638654.827553:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d07b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14420:1875523183678208:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788638654.827586:0:14420:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1788638654.827644:0:14420:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d07b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14420:1875523183678336:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788638654.827683:0:14420:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638654.827729:0:14420:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73ad646240 going to sleep for 11 seconds 00000100:00100000:1.0:1788638654.827749:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183678336 00000100:00100000:1.0:1788638654.827756:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183678336 00000100:00100000:1.0:1788638654.827817:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788638654.827826:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14420:x1875523183678336:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788638654.827871:0:15078:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1788638654.827877:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638654.833198:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7d05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14420:x1875523183678336:12345-0@lo:5:osp-pre-1-0.0 Request processed in 5364us (5505us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788638654.833213:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788638654.833338:0:14420:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d07b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14420:1875523183678336:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788638654.833358:0:14420:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000040:00080000:0.0:1788638655.201664:0:14429:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:2.0:1788638655.333384:0:7651:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788638655.333444:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788638655.521370:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638656.548291:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638657.570200:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788638658.225663:0:16152:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg334-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788638658.599552:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638659.296323:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183678464:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788638659.296396:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638659.296449:0:15080:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183678464 00000100:00100000:2.0:1788638659.296458:0:15080:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183678464 00000100:00100000:2.0:1788638659.296517:0:15080:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788638659.296527:0:15080:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183678464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788638659.296570:0:15080:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788638659.296854:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788638659.296969:0:15080:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183678464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 443us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638659.296980:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183678464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788638659.296986:0:15080:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1788638659.621263:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638659.808177:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183678976:0@lo:400:kworker.0 00000100:00100000:2.0:1788638659.808246:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638659.808306:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788638659.808313:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183678592:0@lo:400:kworker.0 00000100:00100000:2.0:1788638659.808346:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638659.808365:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1875523183679104:0@lo:400:kworker.0 00000100:00100000:2.0:1788638659.808389:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638659.808412:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183678720:0@lo:400:kworker.0 00000100:00100000:2.0:1788638659.808441:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638659.808457:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788638659.808462:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183678848:0@lo:400:kworker.0 00000100:00100000:1.0:1788638659.808738:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183678592 00000100:00100000:1.0:1788638659.808746:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183678592 00000100:00100000:1.0:1788638659.808814:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788638659.808824:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3291:x1875523183678592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638659.808970:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3291:x1875523183678592:12345-0@lo:400:kworker.0 Request processed in 148us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638659.808977:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788638659.809010:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183678720 00000100:00100000:1.0:1788638659.809013:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183678720 00000100:00100000:1.0:1788638659.809047:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788638659.809052:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183678720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638659.809082:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183678720:12345-0@lo:400:kworker.0 Request processed in 30us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638659.809088:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788638659.809327:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788638659.809365:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183678592:0@lo:400:kworker.0 00000100:00100000:2.0:1788638659.810581:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638659.810656:0:3293:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788638659.810672:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183678720:0@lo:400:kworker.0 00000100:00100000:2.0:1788638659.810692:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183679232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788638659.810732:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638659.810772:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183678976 00000100:00100000:2.0:1788638659.810779:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183678976 00000100:00100000:1.0:1788638659.811073:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183679232 00000100:00100000:1.0:1788638659.811078:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183679232 00000100:00100000:1.0:1788638659.811108:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788638659.811115:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183679232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788638659.811145:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788638659.811190:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183679232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638659.811196:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788638659.811240:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638659.811465:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183679104 00000100:00100000:2.0:1788638659.811470:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183679104 00000100:00100000:2.0:1788638659.811695:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183678848 00000100:00100000:2.0:1788638659.811699:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183678848 00000100:00100000:2.0:1788638659.811714:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788638659.811720:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183678976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638659.811779:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183678976:12345-0@lo:400:kworker.0 Request processed in 58us (3533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638659.811815:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788638659.811830:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788638659.812020:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788638659.812206:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d06680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183679232:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788638659.812300:0:14395:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788638659.812308:0:14395:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:2.0:1788638659.812349:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7385378a80 x1875523183678976/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788638659.812361:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183678976:0@lo:400:kworker.0 00000100:00100000:2.0:1788638659.812381:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875523183679104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638659.812424:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3291:x1875523183679104:12345-0@lo:400:kworker.0 Request processed in 151us (4033us total) trans 0 rc 0/0 00010000:00080000:3.0:1788638659.813503:0:3291:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c738537a680 x1875523183679104/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788638659.813523:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3291:1875523183679104:0@lo:400:kworker.0 00000100:00100000:0.0:1788638659.814811:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788638659.814828:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183678848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638659.814917:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183678848:12345-0@lo:400:kworker.0 Request processed in 94us (6433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638659.814925:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788638659.814969:0:3293:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9c7385378380 x1875523183678848/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788638675 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788638659.814981:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183678848:0@lo:400:kworker.0 00000100:00100000:2.0:1788638659.815098:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788638660.278423:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638660.278620:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174244736 00000100:00100000:0.0:1788638660.278644:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174244736 00000100:00100000:0.0:1788638660.278691:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 75 00000100:00100000:0.0:1788638660.278699:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2363:x1875523174244736:12345-192.168.203.34@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788638660.278730:0:14389:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f4ea1363-ddd7-45b0-8012-313d4f61213a@192.168.203.34@tcp t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:0.0:1788638660.278771:0:14389:0:(genops.c:1385:class_connect()) connect: client f4ea1363-ddd7-45b0-8012-313d4f61213a, cookie 0xa0b1f1e3b4b2bbae 00000100:00080000:0.0:1788638660.279105:0:14389:0:(import.c:65:import_set_state_nolock()) ffff9c73b576e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788638660.279175:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea1363-ddd7-45b0-8012-313d4f61213a+5:2363:x1875523174244736:12345-192.168.203.34@tcp:250:mount.lustre.0 Request processed in 475us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638660.279184:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 75 00000100:00100000:3.0:1788638660.289681:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638660.289832:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174244864 00000100:00100000:1.0:1788638660.289843:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174244864 00000100:00100000:1.0:1788638660.289899:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 76 00000100:00100000:1.0:1788638660.289922:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+5:13762:x1875523174244864:12345-192.168.203.34@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788638660.289939:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638660.289956:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73b5569c00/0xa0b1f1e3b4b2bbb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a14351b1 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638660.289985:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73b5569c00/0xa0b1f1e3b4b2bbb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14351b1 expref: 6 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638660.289998:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73b5569c00/0xa0b1f1e3b4b2bbb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14351b1 expref: 6 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638660.290008:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5569c00, rc 0) 00000100:00100000:1.0:1788638660.290066:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+6:13762:x1875523174244864:12345-192.168.203.34@tcp:101:mount.lustre.0 Request processed in 145us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638660.290073:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 76 00000100:00100000:3.0:1788638660.294843:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638660.295146:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174244992 00000100:00100000:0.0:1788638660.295155:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174244992 00000100:00100000:0.0:1788638660.295211:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 77 00000100:00100000:0.0:1788638660.295220:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea1363-ddd7-45b0-8012-313d4f61213a+6:13762:x1875523174244992:12345-192.168.203.34@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788638660.295595:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea1363-ddd7-45b0-8012-313d4f61213a+6:13762:x1875523174244992:12345-192.168.203.34@tcp:501:mount.lustre.0 Request processed in 374us (760us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788638660.295604:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 77 00000100:00100000:3.0:1788638660.298353:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638660.298489:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174245120 00000100:00100000:2.0:1788638660.298508:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174245120 00000100:00100000:2.0:1788638660.298569:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 78 00000100:00100000:2.0:1788638660.298579:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+6:13762:x1875523174245120:12345-192.168.203.34@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788638660.298595:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638660.298612:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2bbbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a14351b8 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638660.298639:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2bbbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14351b8 expref: 7 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638660.298650:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7399aa7a00/0xa0b1f1e3b4b2bbbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14351b8 expref: 7 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638660.298676:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7a00, rc 0) 00000100:00100000:2.0:1788638660.298732:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+7:13762:x1875523174245120:12345-192.168.203.34@tcp:101:mount.lustre.0 Request processed in 154us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638660.298739:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 78 00000100:00100000:3.0:1788638660.300852:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638660.300993:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174245248 00000100:00100000:2.0:1788638660.301002:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174245248 00000100:00100000:2.0:1788638660.301053:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 79 00000100:00100000:2.0:1788638660.301062:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+7:13762:x1875523174245248:12345-192.168.203.34@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788638660.301357:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+8:13762:x1875523174245248:12345-192.168.203.34@tcp:501:mount.lustre.0 Request processed in 294us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638660.301366:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 79 00000100:00100000:3.0:1788638660.305879:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638660.306036:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174245376 00000100:00100000:0.0:1788638660.306045:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174245376 00000100:00100000:0.0:1788638660.306096:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 80 00000100:00100000:0.0:1788638660.306104:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea1363-ddd7-45b0-8012-313d4f61213a+8:13762:x1875523174245376:12345-192.168.203.34@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788638660.306529:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea1363-ddd7-45b0-8012-313d4f61213a+8:13762:x1875523174245376:12345-192.168.203.34@tcp:503:mount.lustre.0 Request processed in 422us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638660.306547:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 80 00000100:00100000:3.0:1788638660.316092:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638660.318232:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174245504 00000100:00100000:1.0:1788638660.318246:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174245504 00000100:00100000:1.0:1788638660.318343:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 81 00000100:00100000:1.0:1788638660.318354:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b450d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+8:13780:x1875523174245504:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788638660.318800:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b450d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+8:13780:x1875523174245504:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 428us (2697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638660.318810:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 81 00000100:00100000:3.0:1788638660.342455:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638660.347167:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174245632 00000100:00100000:2.0:1788638660.347182:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174245632 00000100:00100000:2.0:1788638660.347283:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 82 00000100:00100000:2.0:1788638660.347295:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+8:13780:x1875523174245632:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788638660.347657:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdf9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+8:13780:x1875523174245632:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 363us (5208us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638660.347665:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 82 00000100:00100000:3.0:1788638660.357827:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638660.358248:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174245760 00000100:00100000:1.0:1788638660.358258:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174245760 00000100:00100000:1.0:1788638660.358309:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 83 00000100:00100000:1.0:1788638660.358318:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+8:13762:x1875523174245760:12345-192.168.203.34@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788638660.358333:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638660.358361:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73b5569e00/0xa0b1f1e3b4b2bbc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a14351e2 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638660.358388:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73b5569e00/0xa0b1f1e3b4b2bbc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14351e2 expref: 9 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638660.358399:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73b5569e00/0xa0b1f1e3b4b2bbc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14351e2 expref: 9 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638660.358409:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5569e00, rc 0) 00000100:00100000:1.0:1788638660.358457:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdf9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+9:13762:x1875523174245760:12345-192.168.203.34@tcp:101:mount.lustre.0 Request processed in 139us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638660.358463:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 83 00000100:00100000:3.0:1788638660.368965:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638660.369092:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174245888 00000100:00100000:2.0:1788638660.369104:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174245888 00000100:00100000:2.0:1788638660.369176:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 84 00000100:00100000:2.0:1788638660.369187:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+9:13762:x1875523174245888:12345-192.168.203.34@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788638660.369210:0:14388:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788638660.369228:0:14388:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788638660.369237:0:14388:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788638660.369241:0:14388:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788638660.369244:0:14388:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788638660.372767:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdf9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+9:13762:x1875523174245888:12345-192.168.203.34@tcp:256:mount.lustre.0 Request processed in 3563us (3793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638660.372817:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 84 00000100:00100000:3.0:1788638660.384503:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638660.384660:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174246016 00000100:00100000:0.0:1788638660.384670:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174246016 00000100:00100000:0.0:1788638660.384722:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 85 00000100:00100000:0.0:1788638660.384748:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea1363-ddd7-45b0-8012-313d4f61213a+9:13762:x1875523174246016:12345-192.168.203.34@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788638660.384768:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638660.384821:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bbca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a14351e9 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638660.384849:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bbca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14351e9 expref: 10 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638660.384861:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bbca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14351e9 expref: 10 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638660.384870:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5466a00, rc 0) 00000100:00100000:0.0:1788638660.384926:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdfb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea1363-ddd7-45b0-8012-313d4f61213a+10:13762:x1875523174246016:12345-192.168.203.34@tcp:101:mount.lustre.0 Request processed in 180us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638660.384932:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 85 00000100:00100000:3.0:1788638660.390736:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638660.392233:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174246144 00000100:00100000:2.0:1788638660.392247:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174246144 00000100:00100000:2.0:1788638660.392314:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 86 00000100:00100000:2.0:1788638660.392325:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+10:13762:x1875523174246144:12345-192.168.203.34@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788638660.392651:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdfa450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+10:13762:x1875523174246144:12345-192.168.203.34@tcp:501:mount.lustre.0 Request processed in 327us (1924us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638660.392660:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 86 00000100:00100000:3.0:1788638660.399093:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638660.399528:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174246272 00000100:00100000:1.0:1788638660.399547:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174246272 00000100:00100000:1.0:1788638660.399613:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 87 00000100:00100000:1.0:1788638660.399623:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+10:13762:x1875523174246272:12345-192.168.203.34@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788638660.400057:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdf8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+10:13762:x1875523174246272:12345-192.168.203.34@tcp:503:mount.lustre.0 Request processed in 434us (972us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638660.400066:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 87 00000100:00100000:3.0:1788638660.404724:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638660.404965:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174246400 00000100:00100000:0.0:1788638660.404975:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174246400 00000100:00100000:0.0:1788638660.405030:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 88 00000100:00100000:0.0:1788638660.405040:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea1363-ddd7-45b0-8012-313d4f61213a+10:13785:x1875523174246400:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788638660.405353:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdfac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea1363-ddd7-45b0-8012-313d4f61213a+10:13785:x1875523174246400:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 313us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638660.405361:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 88 00000100:00100000:3.0:1788638660.419895:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638660.419993:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174246528 00000100:00100000:2.0:1788638660.420003:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174246528 00000100:00100000:2.0:1788638660.420059:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 89 00000100:00100000:2.0:1788638660.420070:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+10:13785:x1875523174246528:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788638660.420339:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdf8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+10:13785:x1875523174246528:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 270us (453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638660.420347:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 89 00000100:00100000:3.0:1788638660.428689:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638660.428964:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174246656 00000100:00100000:0.0:1788638660.428974:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174246656 00000100:00100000:0.0:1788638660.429022:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 4 00000100:00100000:0.0:1788638660.429030:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2363:x1875523174246656:12345-192.168.203.34@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788638660.429060:0:14396:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0a963600-85ae-4d04-99fd-4389bf419479@192.168.203.34@tcp t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:0.0:1788638660.429137:0:14396:0:(genops.c:1385:class_connect()) connect: client 0a963600-85ae-4d04-99fd-4389bf419479, cookie 0xa0b1f1e3b4b2bbd1 00000004:00100000:0.0:1788638660.429168:0:14396:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000001:00000004:0.0:1788638660.429174:0:14396:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788638660.498311:0:14396:0:(import.c:65:import_set_state_nolock()) ffff9c73b576f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788638660.498395:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a963600-85ae-4d04-99fd-4389bf419479+6:2363:x1875523174246656:12345-192.168.203.34@tcp:38:mount.lustre.0 Request processed in 69364us (69715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638660.498406:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 4 00000100:00100000:3.0:1788638660.501188:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638660.501274:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638660.501498:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174246784 00000100:00100000:2.0:1788638660.501508:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174246784 00000100:00100000:2.0:1788638660.501605:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174246912 00000100:00100000:2.0:1788638660.501609:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174246912 00000100:00080000:3.0:1788638660.501654:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788638660.504101:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 5 00000100:00100000:2.0:1788638660.504950:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00100000:2.0:1788638660.504969:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+7:13762:x1875523174246912:12345-192.168.203.34@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788638660.505029:0:14395:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788638660.505153:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+7:13762:x1875523174246912:12345-192.168.203.34@tcp:41:mount.lustre.0 Request processed in 193us (3878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638660.505161:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00100000:1.0:1788638660.505906:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+6:0:x1875523174246784:12345-192.168.203.34@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788638660.505995:0:16245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788638660.506042:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+6:0:x1875523174246784:12345-192.168.203.34@tcp:41:mount.lustre.0 Request processed in 1928us (4862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638660.506050:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 5 00000100:00100000:0.0:1788638660.508511:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638660.512220:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174247040 00000100:00100000:2.0:1788638660.512236:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174247040 00000100:00100000:2.0:1788638660.512310:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 7 00000100:00100000:2.0:1788638660.512321:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+6:13762:x1875523174247040:12345-192.168.203.34@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788638660.512607:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+6:13762:x1875523174247040:12345-192.168.203.34@tcp:40:mount.lustre.0 Request processed in 286us (4114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638660.512616:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 7 00000100:00100000:2.0:1788638660.521066:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638660.521119:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638660.521164:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638660.521670:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174247424 00000100:00100000:0.0:1788638660.521679:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174247424 00000100:00100000:0.0:1788638660.521733:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 0 00000100:00100000:0.0:1788638660.521743:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a963600-85ae-4d04-99fd-4389bf419479+6:13762:x1875523174247424:12345-192.168.203.34@tcp:33:mount.lustre.0 00000004:00080000:2.0:1788638660.522972:0:14398:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1137us 00000100:00100000:3.0:1788638660.524260:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174247168 00000100:00100000:3.0:1788638660.524271:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174247168 00000100:00100000:3.0:1788638660.524303:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174247296 00000100:00100000:3.0:1788638660.524306:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174247296 00000100:00100000:3.0:1788638660.524323:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:3.0:1788638660.524575:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2363:x1875523174247168:12345-192.168.203.34@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788638660.524724:0:15078:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0a963600-85ae-4d04-99fd-4389bf419479@192.168.203.34@tcp t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:3.0:1788638660.524763:0:15078:0:(genops.c:1385:class_connect()) connect: client 0a963600-85ae-4d04-99fd-4389bf419479, cookie 0xa0b1f1e3b4b2bbd8 00002000:00100000:3.0:1788638660.524775:0:15078:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0a963600-85ae-4d04-99fd-4389bf419479/ffff9c73acdc0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788638660.524802:0:15078:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:3.0:1788638660.525851:0:15078:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788638660.525890:0:15078:0:(import.c:65:import_set_state_nolock()) ffff9c73acdc4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788638660.526023:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385379500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a963600-85ae-4d04-99fd-4389bf419479+6:2363:x1875523174247168:12345-192.168.203.34@tcp:8:mount.lustre.0 Request processed in 1449us (4902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638660.526034:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:3.0:1788638660.526064:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:3.0:1788638660.526069:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2363:x1875523174247296:12345-192.168.203.34@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788638660.526090:0:15078:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0a963600-85ae-4d04-99fd-4389bf419479@192.168.203.34@tcp t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:3.0:1788638660.526124:0:15078:0:(genops.c:1385:class_connect()) connect: client 0a963600-85ae-4d04-99fd-4389bf419479, cookie 0xa0b1f1e3b4b2bbdf 00002000:00100000:3.0:1788638660.526135:0:15078:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0a963600-85ae-4d04-99fd-4389bf419479/ffff9c73acdc2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788638660.526144:0:15078:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:3.0:1788638660.526402:0:15078:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788638660.526419:0:15078:0:(import.c:65:import_set_state_nolock()) ffff9c73acdc2800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788638660.526445:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a963600-85ae-4d04-99fd-4389bf419479+6:2363:x1875523174247296:12345-192.168.203.34@tcp:8:mount.lustre.0 Request processed in 374us (5280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638660.526452:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 9 00000004:00200000:2.0:1788638660.565754:0:14398:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788638660.565923:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a963600-85ae-4d04-99fd-4389bf419479+6:13762:x1875523174247424:12345-192.168.203.34@tcp:33:mount.lustre.0 Request processed in 44173us (44858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638660.565943:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 0 00010000:00010000:3.0:1788638660.642389:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638660.760612:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638660.760725:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174247552 00000100:00100000:0.0:1788638660.760735:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174247552 00000100:00100000:0.0:1788638660.760905:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:0.0:1788638660.760916:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+6:13806:x1875523174247552:12345-192.168.203.34@tcp:101:mkdir.0 00010000:00010000:0.0:1788638660.760937:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638660.760962:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467000/0xa0b1f1e3b4b2bbe6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435213 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638660.761028:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2bbed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638660.761043:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2bbed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638660.761058:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2bbed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638660.761125:0:14397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788638660.761130:0:14397:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638660.761170:0:14397:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2bbed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638660.761201:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467000/0xa0b1f1e3b4b2bbe6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435213 expref: 8 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638660.761221:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2bbed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435213 expref: 7 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638660.761231:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a62bfc00) 00010000:00010000:0.0:1788638660.761233:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788638660.761237:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5466600, rc 0) 00000100:00100000:0.0:1788638660.761299:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+7:13806:x1875523174247552:12345-192.168.203.34@tcp:101:mkdir.0 Request processed in 385us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638660.761306:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 8 00010000:00010000:1.0:1788638661.666669:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788638662.447907:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0a963600-85ae-4d04-99fd-4389bf419479 00010000:00010000:3.0:1788638662.688090:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638663.080546:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638663.080719:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174247680 00000100:00100000:3.0:1788638663.080730:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174247680 00000100:00100000:3.0:1788638663.080834:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:3.0:1788638663.080846:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+7:13859:x1875523174247680:12345-192.168.203.34@tcp:41:lfs.0 00000004:00000024:3.0:1788638663.080911:0:16245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788638663.080994:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+7:13859:x1875523174247680:12345-192.168.203.34@tcp:41:lfs.0 Request processed in 151us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638663.081003:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00080000:2.0:1788638663.081289:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638663.085254:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638663.086074:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174247808 00000100:00100000:1.0:1788638663.086089:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174247808 00000100:00100000:1.0:1788638663.086197:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 5 00000100:00100000:1.0:1788638663.086208:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0a963600-85ae-4d04-99fd-4389bf419479+5:13859:x1875523174247808:12345-192.168.203.34@tcp:13:lfs.0 00002000:00000024:1.0:1788638663.086245:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788638663.086340:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b48700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0a963600-85ae-4d04-99fd-4389bf419479+5:13859:x1875523174247808:12345-192.168.203.34@tcp:13:lfs.0 Request processed in 132us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638663.086347:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 5 00000100:00080000:2.0:1788638663.086529:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788638663.090992:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638663.091145:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174247936 00000100:00100000:1.0:1788638663.091159:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174247936 00000100:00100000:1.0:1788638663.091244:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00100000:1.0:1788638663.091255:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0a963600-85ae-4d04-99fd-4389bf419479+6:13859:x1875523174247936:12345-192.168.203.34@tcp:13:lfs.0 00002000:00000024:1.0:1788638663.091290:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788638663.091391:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b49f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:0a963600-85ae-4d04-99fd-4389bf419479+6:13859:x1875523174247936:12345-192.168.203.34@tcp:13:lfs.0 Request processed in 137us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638663.091399:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00080000:2.0:1788638663.091584:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788638663.351577:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638663.352035:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174248064 00000100:00100000:1.0:1788638663.352045:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174248064 00000100:00100000:1.0:1788638663.352101:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 90 00000100:00100000:1.0:1788638663.352111:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+10:13891:x1875523174248064:12345-192.168.203.34@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788638663.352128:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638663.352146:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73b5568a00/0xa0b1f1e3b4b2bbf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a143521a expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638663.352174:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73b5568a00/0xa0b1f1e3b4b2bbf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143521a expref: 11 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638663.352205:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73b5568a00/0xa0b1f1e3b4b2bbf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143521a expref: 11 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638663.352222:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5568a00, rc 0) 00000100:00100000:1.0:1788638663.352329:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdf9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+11:13891:x1875523174248064:12345-192.168.203.34@tcp:101:mount.lustre.0 Request processed in 220us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638663.352336:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 90 00000100:00100000:0.0:1788638663.368012:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638663.368132:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174248192 00000100:00100000:2.0:1788638663.368141:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174248192 00000100:00100000:2.0:1788638663.368187:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 91 00000100:00100000:2.0:1788638663.368194:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea1363-ddd7-45b0-8012-313d4f61213a+11:13891:x1875523174248192:12345-192.168.203.34@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788638663.368602:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdfa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea1363-ddd7-45b0-8012-313d4f61213a+11:13891:x1875523174248192:12345-192.168.203.34@tcp:501:mount.lustre.0 Request processed in 406us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638663.368611:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 91 00000100:00100000:3.0:1788638663.380541:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638663.381417:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174248320 00000100:00100000:1.0:1788638663.381432:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174248320 00000100:00100000:1.0:1788638663.381501:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 92 00000100:00100000:1.0:1788638663.381519:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73acdf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+11:13891:x1875523174248320:12345-192.168.203.34@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788638663.381826:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73acdf8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+11:13891:x1875523174248320:12345-192.168.203.34@tcp:503:mount.lustre.0 Request processed in 315us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638663.382167:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 92 00000100:00100000:0.0:1788638663.398956:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638663.399662:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174248448 00000100:00100000:1.0:1788638663.399678:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174248448 00000100:00100000:1.0:1788638663.399751:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 93 00000100:00100000:1.0:1788638663.399761:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73a63cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+11:13898:x1875523174248448:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788638663.400335:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73a63cd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+11:13898:x1875523174248448:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 574us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638663.400344:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 93 00000100:00100000:0.0:1788638663.426244:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638663.426373:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174248576 00000100:00100000:2.0:1788638663.426387:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174248576 00000100:00100000:2.0:1788638663.426482:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 94 00000100:00100000:2.0:1788638663.426495:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73a63cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea1363-ddd7-45b0-8012-313d4f61213a+11:13898:x1875523174248576:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788638663.426930:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73a63cf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea1363-ddd7-45b0-8012-313d4f61213a+11:13898:x1875523174248576:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 433us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638663.426940:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 94 00000100:00100000:3.0:1788638663.435004:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638663.435310:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174248704 00000100:00100000:1.0:1788638663.435323:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174248704 00000100:00100000:1.0:1788638663.435397:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 95 00000100:00100000:1.0:1788638663.435409:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf62a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+11:13891:x1875523174248704:12345-192.168.203.34@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788638663.435450:0:14388:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638663.435486:0:14388:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73b5568e00/0xa0b1f1e3b4b2bbfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435244 expref: -99 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638663.435533:0:14388:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73b5568e00/0xa0b1f1e3b4b2bbfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435244 expref: 12 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638663.435548:0:14388:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73b5568e00/0xa0b1f1e3b4b2bbfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435244 expref: 12 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638663.435558:0:14388:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5568e00, rc 0) 00000100:00100000:1.0:1788638663.435629:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf62a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+12:13891:x1875523174248704:12345-192.168.203.34@tcp:101:mount.lustre.0 Request processed in 223us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638663.435637:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 95 00000100:00100000:0.0:1788638663.443963:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638663.447726:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174248832 00000100:00100000:1.0:1788638663.447749:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174248832 00000100:00100000:1.0:1788638663.447890:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 96 00000100:00100000:1.0:1788638663.447902:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+12:13891:x1875523174248832:12345-192.168.203.34@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788638663.447936:0:14387:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788638663.447984:0:14387:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788638663.447989:0:14387:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788638663.447993:0:14387:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788638663.447996:0:14387:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788638663.458961:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf629850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+12:13891:x1875523174248832:12345-192.168.203.34@tcp:256:mount.lustre.0 Request processed in 11042us (14995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638663.458981:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 96 00000100:00100000:3.0:1788638663.462999:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638663.463213:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174248960 00000100:00100000:2.0:1788638663.463227:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174248960 00000100:00100000:2.0:1788638663.463302:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 97 00000100:00100000:2.0:1788638663.463314:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf62b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea1363-ddd7-45b0-8012-313d4f61213a+12:13891:x1875523174248960:12345-192.168.203.34@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788638663.463337:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638663.463362:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2bc02 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a143524b expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638663.463403:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2bc02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143524b expref: 13 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638663.463417:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2bc02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143524b expref: 13 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638663.463438:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7c00, rc 0) 00000100:00100000:2.0:1788638663.463522:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf62b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:13891:x1875523174248960:12345-192.168.203.34@tcp:101:mount.lustre.0 Request processed in 211us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638663.463547:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 97 00000100:00100000:0.0:1788638663.470928:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638663.471076:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174249088 00000100:00100000:1.0:1788638663.471109:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174249088 00000100:00100000:1.0:1788638663.471191:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 98 00000100:00100000:1.0:1788638663.471203:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf62b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:13891:x1875523174249088:12345-192.168.203.34@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788638663.471826:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf62b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:13891:x1875523174249088:12345-192.168.203.34@tcp:501:mount.lustre.0 Request processed in 620us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638663.471837:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 98 00000100:00100000:0.0:1788638663.476741:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638663.476886:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174249216 00000100:00100000:2.0:1788638663.476901:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174249216 00000100:00100000:2.0:1788638663.476983:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 99 00000100:00100000:2.0:1788638663.476994:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf62a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:13891:x1875523174249216:12345-192.168.203.34@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788638663.477325:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf62a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:13891:x1875523174249216:12345-192.168.203.34@tcp:503:mount.lustre.0 Request processed in 331us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638663.477334:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 99 00000100:00100000:3.0:1788638663.480029:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638663.480284:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174249344 00000100:00100000:2.0:1788638663.480297:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174249344 00000100:00100000:2.0:1788638663.480370:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 100 00000100:00100000:2.0:1788638663.480381:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:13903:x1875523174249344:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788638663.480729:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf629450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:13903:x1875523174249344:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 349us (714us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638663.480739:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 100 00000100:00100000:0.0:1788638663.484861:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638663.484976:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174249472 00000100:00100000:1.0:1788638663.484990:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174249472 00000100:00100000:1.0:1788638663.485064:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 101 00000100:00100000:1.0:1788638663.485076:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf62ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:13903:x1875523174249472:12345-192.168.203.34@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788638663.485456:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf62ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:13903:x1875523174249472:12345-192.168.203.34@tcp:502:llog_process_th.0 Request processed in 380us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638663.485465:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 101 00000100:00100000:3.0:1788638663.497451:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638663.498255:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174249600 00000100:00100000:0.0:1788638663.498290:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174249600 00000100:00100000:0.0:1788638663.498359:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:0.0:1788638663.498369:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2363:x1875523174249600:12345-192.168.203.34@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788638663.498410:0:14396:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6181e191-5f1a-46ec-b515-69664fc84af5@192.168.203.34@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:0.0:1788638663.498467:0:14396:0:(genops.c:1385:class_connect()) connect: client 6181e191-5f1a-46ec-b515-69664fc84af5, cookie 0xa0b1f1e3b4b2bc09 00000004:00100000:0.0:1788638663.498528:0:14396:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return 37 00000100:00080000:0.0:1788638663.498709:0:14396:0:(import.c:65:import_set_state_nolock()) ffff9c7398b89800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788638663.498852:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b48e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6181e191-5f1a-46ec-b515-69664fc84af5+6:2363:x1875523174249600:12345-192.168.203.34@tcp:38:mount.lustre.0 Request processed in 482us (1415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638663.498862:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:3.0:1788638663.507094:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638663.507279:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174249728 00000100:00100000:1.0:1788638663.507292:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174249728 00000100:00100000:1.0:1788638663.507393:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 11 00000100:00100000:1.0:1788638663.507405:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6181e191-5f1a-46ec-b515-69664fc84af5+6:0:x1875523174249728:12345-192.168.203.34@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788638663.507446:0:16245:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788638663.507622:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6181e191-5f1a-46ec-b515-69664fc84af5+6:0:x1875523174249728:12345-192.168.203.34@tcp:41:mount.lustre.0 Request processed in 219us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638663.507631:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 11 00000100:00080000:2.0:1788638663.509242:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788638663.510829:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638663.510945:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174249856 00000100:00100000:0.0:1788638663.510959:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174249856 00000100:00100000:0.0:1788638663.511032:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00100000:0.0:1788638663.511044:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6181e191-5f1a-46ec-b515-69664fc84af5+6:13891:x1875523174249856:12345-192.168.203.34@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788638663.511171:0:14396:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788638663.512315:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7d06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6181e191-5f1a-46ec-b515-69664fc84af5+6:13891:x1875523174249856:12345-192.168.203.34@tcp:41:mount.lustre.0 Request processed in 1259us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638663.512330:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00100000:3.0:1788638663.527694:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638663.531680:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174249984 00000100:00100000:1.0:1788638663.531705:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174249984 00000100:00100000:1.0:1788638663.531892:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:1.0:1788638663.531905:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6181e191-5f1a-46ec-b515-69664fc84af5+6:13891:x1875523174249984:12345-192.168.203.34@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788638663.532072:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b49500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6181e191-5f1a-46ec-b515-69664fc84af5+6:13891:x1875523174249984:12345-192.168.203.34@tcp:40:mount.lustre.0 Request processed in 167us (4392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638663.532082:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:2.0:1788638663.541998:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638663.544460:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174250368 00000100:00100000:0.0:1788638663.544490:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174250368 00000100:00100000:0.0:1788638663.544582:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 1 00000100:00100000:0.0:1788638663.544593:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6181e191-5f1a-46ec-b515-69664fc84af5+6:13891:x1875523174250368:12345-192.168.203.34@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788638663.544693:0:14399:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788638663.544870:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6181e191-5f1a-46ec-b515-69664fc84af5+6:13891:x1875523174250368:12345-192.168.203.34@tcp:33:mount.lustre.0 Request processed in 277us (2886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638663.544880:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 1 00000100:00100000:3.0:1788638663.546851:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638663.546904:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638663.547006:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174250112 00000100:00100000:1.0:1788638663.547018:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174250112 00000100:00100000:1.0:1788638663.547074:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174250240 00000100:00100000:1.0:1788638663.547078:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174250240 00000100:00100000:1.0:1788638663.547106:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:1.0:1788638663.547115:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2363:x1875523174250112:12345-192.168.203.34@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788638663.547157:0:15078:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6181e191-5f1a-46ec-b515-69664fc84af5@192.168.203.34@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:1.0:1788638663.547204:0:15078:0:(genops.c:1385:class_connect()) connect: client 6181e191-5f1a-46ec-b515-69664fc84af5, cookie 0xa0b1f1e3b4b2bc10 00002000:00100000:1.0:1788638663.547219:0:15078:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6181e191-5f1a-46ec-b515-69664fc84af5/ffff9c73ae186800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788638663.547233:0:15078:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return 37 00002000:00080000:1.0:1788638663.547743:0:15078:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788638663.547816:0:15078:0:(import.c:65:import_set_state_nolock()) ffff9c73ae182000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788638663.547909:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b48000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6181e191-5f1a-46ec-b515-69664fc84af5+6:2363:x1875523174250112:12345-192.168.203.34@tcp:8:mount.lustre.0 Request processed in 792us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638663.547920:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:1.0:1788638663.547948:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 11 00000100:00100000:1.0:1788638663.547955:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2363:x1875523174250240:12345-192.168.203.34@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788638663.547976:0:15078:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6181e191-5f1a-46ec-b515-69664fc84af5@192.168.203.34@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:1.0:1788638663.547997:0:15078:0:(genops.c:1385:class_connect()) connect: client 6181e191-5f1a-46ec-b515-69664fc84af5, cookie 0xa0b1f1e3b4b2bc17 00002000:00100000:1.0:1788638663.548005:0:15078:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6181e191-5f1a-46ec-b515-69664fc84af5/ffff9c73ae186000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a03 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788638663.548011:0:15078:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return 37 00002000:00080000:1.0:1788638663.548698:0:15078:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788638663.548728:0:15078:0:(import.c:65:import_set_state_nolock()) ffff9c73ae183800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788638663.549883:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6181e191-5f1a-46ec-b515-69664fc84af5+6:2363:x1875523174250240:12345-192.168.203.34@tcp:8:mount.lustre.0 Request processed in 1915us (2965us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638663.549900:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 11 00010000:00010000:3.0:1788638663.713490:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638663.771262:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638663.771517:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174250496 00000100:00100000:2.0:1788638663.771531:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174250496 00000100:00100000:2.0:1788638663.771621:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 14 00000100:00100000:2.0:1788638663.771633:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6181e191-5f1a-46ec-b515-69664fc84af5+6:13924:x1875523174250496:12345-192.168.203.34@tcp:101:mkdir.0 00010000:00010000:2.0:1788638663.771660:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638663.771708:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bc1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435275 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638663.772128:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2bc25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638663.772221:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2bc25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638663.772239:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2bc25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638663.772291:0:14397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788638663.772296:0:14397:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788638663.772322:0:14397:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2bc25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638663.772355:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bc1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435275 expref: 8 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638663.772377:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2bc25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435275 expref: 7 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638663.772387:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a62bfc00) 00010000:00010000:2.0:1788638663.772390:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788638663.772394:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6000, rc 0) 00000100:00100000:2.0:1788638663.772536:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b49180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6181e191-5f1a-46ec-b515-69664fc84af5+7:13924:x1875523174250496:12345-192.168.203.34@tcp:101:mkdir.0 Request processed in 904us (1290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638663.772545:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 14 00000100:00100000:0.0:1788638664.416545:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788638664.416578:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183679360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788638664.416677:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638664.416894:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183679360 00000100:00100000:1.0:1788638664.416906:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183679360 00000100:00100000:1.0:1788638664.417013:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788638664.417028:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183679360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788638664.417059:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788638664.417123:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183679360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638664.417131:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788638664.417185:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183679360:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788638664.417396:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788638664.737169:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638664.929530:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788638664.929565:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183679488:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788638664.929670:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638664.932832:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183679488 00000100:00100000:1.0:1788638664.932857:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183679488 00000100:00100000:1.0:1788638664.932965:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788638664.932978:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183679488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788638664.933044:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788638664.933160:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183679488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 184us (3490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638664.933168:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788638664.933309:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788638664.933447:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d07480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183679488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788638664.934581:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7391b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183679744:0@lo:400:kworker.0 00000100:00100000:3.0:1788638664.934659:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638664.934712:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7391b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183680256:0@lo:400:kworker.0 00000100:00100000:3.0:1788638664.934742:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638664.934767:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788638664.934773:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7391b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183679872:0@lo:400:kworker.0 00000100:00100000:3.0:1788638664.934830:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638664.934881:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183679744 00000100:00100000:3.0:1788638664.934890:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183679744 00000100:00100000:3.0:1788638664.934939:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183679872 00000100:00100000:3.0:1788638664.934942:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183679872 00000100:00100000:3.0:1788638664.934959:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788638664.934968:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183679744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638664.935036:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183679744:12345-0@lo:400:kworker.0 Request processed in 55us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638664.935043:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788638664.935062:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638664.935068:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183679872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638664.935096:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b49880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183679872:12345-0@lo:400:kworker.0 Request processed in 28us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638664.935102:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788638664.935121:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7391b48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183680000:0@lo:400:kworker.0 00000100:00100000:3.0:1788638664.935148:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638664.935170:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788638664.935176:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7391b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183679616:0@lo:400:kworker.0 00000100:00100000:3.0:1788638664.935206:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638664.935228:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7391b49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183680128:0@lo:400:kworker.0 00000100:00100000:3.0:1788638664.935251:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638664.935411:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183680256 00000100:00100000:0.0:1788638664.935417:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183680256 00000100:00100000:0.0:1788638664.935459:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183680000 00000100:00100000:0.0:1788638664.935461:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183680000 00000100:00100000:0.0:1788638664.935473:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183680128 00000100:00100000:0.0:1788638664.935475:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183680128 00000100:00100000:0.0:1788638664.935491:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788638664.935509:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183680256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638664.935549:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3293:x1875523183680256:12345-0@lo:400:kworker.0 Request processed in 51us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638664.935555:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788638664.935571:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788638664.935576:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183680000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638664.935603:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3291:x1875523183680000:12345-0@lo:400:kworker.0 Request processed in 28us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638664.935609:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788638664.935620:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788638664.935625:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183680128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638664.936648:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7391b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183679872:0@lo:400:kworker.0 00000100:00100000:2.0:1788638664.936683:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7391b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183679744:0@lo:400:kworker.0 00000100:00100000:2.0:1788638664.936698:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7391b4b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3293:1875523183680256:0@lo:400:kworker.0 00000100:00100000:1.0:1788638664.937906:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183679616 00000100:00100000:1.0:1788638664.937923:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183679616 00000100:00100000:1.0:1788638664.938010:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788638664.938035:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf62bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3291:x1875523183679616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638664.938142:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf62bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3291:x1875523183679616:12345-0@lo:400:kworker.0 Request processed in 123us (2934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638664.938165:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788638664.941597:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3291:x1875523183680128:12345-0@lo:400:kworker.0 Request processed in 5955us (6328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638664.941625:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788638664.941693:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638664.946980:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7391b49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3291:1875523183680128:0@lo:400:kworker.0 00000100:00100000:3.0:1788638664.947008:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7391b48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3291:1875523183680000:0@lo:400:kworker.0 00000100:00100000:3.0:1788638664.947056:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7391b4a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183679616:0@lo:400:kworker.0 00000040:00080000:0.0:1788638665.441586:0:14429:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:1.0:1788638665.516926:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6181e191-5f1a-46ec-b515-69664fc84af5 00000001:00100000:1.0:1788638665.516947:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0a963600-85ae-4d04-99fd-4389bf419479 00000001:00100000:1.0:1788638665.540087:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6181e191-5f1a-46ec-b515-69664fc84af5 00000001:00100000:1.0:1788638665.540108:0:7651:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0a963600-85ae-4d04-99fd-4389bf419479 00010000:00010000:3.0:1788638665.762866:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638666.785255:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788638667.121562:0:16361:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:3.0:1788638667.585259:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6181e191-5f1a-46ec-b515-69664fc84af5 00010000:00010000:2.0:1788638667.808821:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638668.556263:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638668.556311:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638668.556343:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638668.556369:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638668.556391:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638668.556411:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638668.556437:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638668.556465:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174250880 00000100:00100000:0.0:1788638668.556486:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174250880 00000100:00100000:0.0:1788638668.556560:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174251392 00000100:00100000:0.0:1788638668.556565:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174251392 00000100:00100000:0.0:1788638668.556582:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174251008 00000100:00100000:0.0:1788638668.556585:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174251008 00000100:00100000:0.0:1788638668.556596:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174251264 00000100:00100000:0.0:1788638668.556598:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174251264 00000100:00100000:0.0:1788638668.556614:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 3 00000100:00100000:0.0:1788638668.556625:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a963600-85ae-4d04-99fd-4389bf419479+5:2364:x1875523174250880:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638668.556713:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a963600-85ae-4d04-99fd-4389bf419479+5:2364:x1875523174250880:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 89us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638668.556722:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 3 00000100:00100000:0.0:1788638668.556740:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 4 00000100:00100000:0.0:1788638668.556747:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6181e191-5f1a-46ec-b515-69664fc84af5+5:2364:x1875523174251392:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638668.556772:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6181e191-5f1a-46ec-b515-69664fc84af5+5:2364:x1875523174251392:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 27us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638668.556826:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 4 00000100:00100000:0.0:1788638668.556840:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 5 00000100:00100000:0.0:1788638668.556846:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a963600-85ae-4d04-99fd-4389bf419479+5:2364:x1875523174251008:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638668.556872:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a963600-85ae-4d04-99fd-4389bf419479+5:2364:x1875523174251008:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 26us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638668.556878:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 5 00000100:00100000:0.0:1788638668.556888:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00100000:0.0:1788638668.556895:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6181e191-5f1a-46ec-b515-69664fc84af5+5:2364:x1875523174251264:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638668.556917:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6181e191-5f1a-46ec-b515-69664fc84af5+5:2364:x1875523174251264:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 22us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638668.556922:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00100000:0.0:1788638668.556943:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174251136 00000100:00100000:0.0:1788638668.556947:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174251136 00000100:00100000:0.0:1788638668.556975:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174250752 00000100:00100000:0.0:1788638668.556979:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174250752 00000100:00100000:0.0:1788638668.556999:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 19 00000100:00100000:0.0:1788638668.557005:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6181e191-5f1a-46ec-b515-69664fc84af5+6:2364:x1875523174251136:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638668.557033:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6181e191-5f1a-46ec-b515-69664fc84af5+6:2364:x1875523174251136:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 28us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638668.557040:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 19 00000100:00100000:0.0:1788638668.557052:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 20 00000100:00100000:0.0:1788638668.557058:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+6:2364:x1875523174250752:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638668.557080:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+6:2364:x1875523174250752:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 22us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638668.557094:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 20 00000100:00080000:0.0:1788638668.557126:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788638668.557131:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788638668.557134:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788638668.563434:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174250624 00000100:00100000:2.0:1788638668.563457:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174250624 00000100:00100000:2.0:1788638668.563561:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 103 00000100:00100000:2.0:1788638668.563574:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:2364:x1875523174250624:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:2.0:1788638668.563676:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf629050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:2364:x1875523174250624:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 106us (7424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638668.563685:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 103 00010000:00010000:3.0:1788638668.834965:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638669.544332:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183680384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788638669.544435:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638669.544588:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183680384 00000100:00100000:3.0:1788638669.544601:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183680384 00000100:00100000:3.0:1788638669.544685:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788638669.544707:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183680384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788638669.544754:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788638669.544851:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7d07100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183680384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638669.544859:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788638669.544918:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387d9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183680384:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788638669.545817:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788638669.857118:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638670.049412:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183680512:0@lo:400:kworker.0 00000100:00100000:3.0:1788638670.049534:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638670.049667:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183680512 00000100:00100000:1.0:1788638670.049678:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183680512 00000100:00100000:1.0:1788638670.049759:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788638670.049770:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3291:x1875523183680512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638670.050843:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf628850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3291:x1875523183680512:12345-0@lo:400:kworker.0 Request processed in 1067us (1301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638670.050856:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788638670.050989:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c738537a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183680512:0@lo:400:kworker.0 00000100:00100000:3.0:1788638670.051012:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788638670.051021:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183680640:0@lo:400:kworker.0 00000100:00100000:3.0:1788638670.051066:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638670.051165:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183680640 00000100:00100000:1.0:1788638670.051172:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183680640 00000100:00100000:1.0:1788638670.051225:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788638670.051234:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183680640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638670.051285:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183680640:12345-0@lo:400:kworker.0 Request processed in 53us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638670.051292:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788638670.051324:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183680640:0@lo:400:kworker.0 00000100:00100000:2.0:1788638670.059235:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183680768:0@lo:400:kworker.0 00000100:00100000:2.0:1788638670.059331:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638670.059451:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183680768 00000100:00100000:2.0:1788638670.059462:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183680768 00000100:00100000:2.0:1788638670.060450:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788638670.060472:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183680768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638670.060566:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183680768:12345-0@lo:400:kworker.0 Request processed in 104us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638670.060574:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788638670.060632:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183680768:0@lo:400:kworker.0 00000100:00100000:2.0:1788638670.060693:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183680896:0@lo:400:kworker.0 00000100:00100000:2.0:1788638670.060732:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638670.060772:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183680896 00000100:00100000:2.0:1788638670.062566:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183680896 00000100:00100000:2.0:1788638670.062659:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788638670.062669:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183680896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788638670.062772:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183680896:12345-0@lo:400:kworker.0 Request processed in 105us (2040us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638670.062797:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788638670.064031:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183680896:0@lo:400:kworker.0 00000100:00100000:3.0:1788638670.065087:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7391b49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1875523183681152:0@lo:400:kworker.0 00000100:00100000:3.0:1788638670.065178:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638670.065232:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788638670.065238:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7391b48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183681024:0@lo:400:kworker.0 00000100:00100000:3.0:1788638670.065262:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638670.065302:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183681152 00000100:00100000:3.0:1788638670.065311:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183681152 00000100:00100000:3.0:1788638670.065368:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183681024 00000100:00100000:3.0:1788638670.065387:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183681024 00000100:00100000:3.0:1788638670.065416:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788638670.065425:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875523183681152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638670.065495:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875523183681152:12345-0@lo:400:kworker.0 Request processed in 71us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638670.065504:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788638670.065523:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788638670.065529:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183681024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788638670.065556:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183681024:12345-0@lo:400:kworker.0 Request processed in 28us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638670.065562:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788638670.065602:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7391b48380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183681024:0@lo:400:kworker.0 00000100:00100000:3.0:1788638670.065612:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7391b49c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1875523183681152:0@lo:400:kworker.0 00000100:00080000:1.0:1788638670.067155:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788638670.067182:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788638670.067285:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183681280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788638670.067372:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638670.067526:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183681280 00000100:00100000:1.0:1788638670.067535:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183681280 00000100:00100000:1.0:1788638670.067597:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788638670.067607:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183681280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788638670.067650:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788638670.067706:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183681280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638670.067713:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788638670.067778:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183681280:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788638670.880162:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788638671.150342:0:16509:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffcf324170 20000000:00000080:0.0:1788638671.150366:0:16509:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9c73b557a400 uarg=0000000000000000 20000000:01000000:0.0:1788638671.150416:0:16509:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788638671.150424:0:16509:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788638671.150430:0:16509:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788638671.152926:0:16510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788638671.153510:0:16509:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788638671.168472:0:16509:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788638671.168966:0:16509:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9c73b5467400/0xa0b1f1e3b4b2bc2c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638671.168992:0:16509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b923 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b91c expref: 18 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638671.169002:0:16509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b970 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2b969 expref: 18 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638671.169007:0:16509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7385308400/0xa0b1f1e3b4b2baab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2baa4 expref: 18 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638671.169018:0:16509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bbca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14351e9 expref: 12 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638671.169026:0:16509:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2bc02 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143524b expref: 12 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638671.169034:0:16509:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9c73b5467400/0xa0b1f1e3b4b2bc2c lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638671.169118:0:16509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2bc02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143524b expref: 12 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638671.169137:0:16509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2bc02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143524b expref: 12 pid: 14389 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638671.169170:0:16509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7398c2c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16509:1875523183681408:192.168.203.34@tcp:104: 00010000:00010000:0.0:1788638671.169318:0:16509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bbca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14351e9 expref: 12 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638671.169328:0:16509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bbca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14351e9 expref: 12 pid: 14389 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638671.169337:0:16509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7398c2dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16509:1875523183681536:192.168.203.34@tcp:104: 00010000:00010000:0.0:1788638671.169371:0:16509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c7385308400/0xa0b1f1e3b4b2baab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2baa4 expref: 18 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638671.169380:0:16509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c7385308400/0xa0b1f1e3b4b2baab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2baa4 expref: 18 pid: 14388 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638671.169390:0:16509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7398c2f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16509:1875523183681664:0@lo:104: 00000100:00100000:0.0:1788638671.169677:0:16509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638671.169758:0:14379:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183681664 00000100:00100000:3.0:1788638671.169768:0:14379:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183681664 00000100:00100000:3.0:1788638671.169857:0:14379:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788638671.169869:0:14379:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+3:16509:x1875523183681664:12345-0@lo:104: 00010000:00010000:3.0:1788638671.169886:0:14379:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c73b5467a00/0xa0b1f1e3b4b2baa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2baab expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638671.178770:0:16509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b970 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b969 expref: 18 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638671.178815:0:16509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b970 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b969 expref: 18 pid: 14388 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638671.178862:0:16509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7398c2c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16509:1875523183681792:0@lo:104: 00000100:00100000:0.0:1788638671.178942:0:16509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788638671.178978:0:16509:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b923 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b91c expref: 18 pid: 14388 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638671.178987:0:16509:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b923 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b91c expref: 18 pid: 14388 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638671.178995:0:16509:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7398c2ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16509:1875523183681920:0@lo:104: 00000100:00100000:0.0:1788638671.179025:0:16509:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638671.179039:0:16509:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7383730000 going to sleep for 11 seconds 00000100:00100000:2.0:1788638671.179136:0:14378:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788638671.179154:0:14378:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788638671.179160:0:14378:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1788638671.180869:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183681792 00000100:00100000:0.0:1788638671.180885:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183681792 00000100:00100000:0.0:1788638671.180950:0:14378:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1788638671.180958:0:14378:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183681920 00000100:00100000:0.0:1788638671.180961:0:14378:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183681920 00000100:00100000:1.0:1788638671.181282:0:16511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788638671.181296:0:16511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+5:16509:x1875523183681792:12345-0@lo:104: 00010000:00010000:1.0:1788638671.181320:0:16511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2b969 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2b970 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638671.181673:0:16511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788638671.181683:0:16511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+5:16509:x1875523183681792:12345-0@lo:104: Request processed in 388us (2739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638671.181691:0:16511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788638671.181715:0:16511:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788638671.181724:0:16511:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b5b2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+4:16509:x1875523183681920:12345-0@lo:104: 00010000:00010000:1.0:1788638671.181734:0:16511:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.134@tcp lock: ffff9c7380031a00/0xa0b1f1e3b4b2b91c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2b923 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638671.181810:0:16511:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788638671.182112:0:16511:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b5b2ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+4:16509:x1875523183681920:12345-0@lo:104: Request processed in 113us (2809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638671.182122:0:16511:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1788638671.182545:0:15767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788638671.182557:0:15767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2b969 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2b970 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.182567:0:15767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c800 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:2.0:1788638671.182573:0:15767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2b969 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2b970 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.182583:0:15767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2b969 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2b970 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788638671.182591:0:15767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2b969 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2b970 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638671.182597:0:15767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788638671.182660:0:15767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2b969 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2b970 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.182677:0:15767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788638671.182709:0:15767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2b969 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2b970 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.182716:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c73bc01c800/0xa0b1f1e3b4b2b969 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2b970 expref: -99 pid: 15075 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.182732:0:15767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638671.182735:0:15767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c7380031a00/0xa0b1f1e3b4b2b91c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2b923 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.182741:0:15767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031a00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:2.0:1788638671.182744:0:15767:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c7380031a00/0xa0b1f1e3b4b2b91c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2b923 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.182751:0:15767:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c7380031a00/0xa0b1f1e3b4b2b91c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2b923 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788638671.182756:0:15767:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c7380031a00/0xa0b1f1e3b4b2b91c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2b923 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638671.182761:0:15767:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788638671.182776:0:15767:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c7380031a00/0xa0b1f1e3b4b2b91c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2b923 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.182812:0:15767:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788638671.182831:0:15767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c7380031a00/0xa0b1f1e3b4b2b91c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2b923 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.182837:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c7380031a00/0xa0b1f1e3b4b2b91c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2b923 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.182853:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638671.182855:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638671.182857:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638671.182876:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7391b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3294:1875523183682048:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788638671.182946:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638671.183021:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7391b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183682176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788638671.183047:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638671.183085:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183682048 00000100:00100000:2.0:1788638671.183093:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183682048 00010000:00010000:2.0:1788638671.183129:0:14382:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b970 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b969 expref: 19 pid: 14388 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638671.183156:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183682176 00000100:00100000:2.0:1788638671.183159:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183682176 00010000:00010000:2.0:1788638671.183171:0:14382:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b923 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b91c expref: 20 pid: 14388 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638671.183186:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788638671.183194:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+20:3294:x1875523183682048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788638671.183208:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638671.183213:0:14382:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b970 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b969 expref: 20 pid: 14388 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.183225:0:14382:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b970 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b969 expref: 20 pid: 14388 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.183247:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638671.183282:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+20:3294:x1875523183682048:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638671.183295:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788638671.183310:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788638671.183316:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3291:x1875523183682176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788638671.183323:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638671.183328:0:14382:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b923 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b91c expref: 19 pid: 14388 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.183337:0:14382:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b923 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b91c expref: 19 pid: 14388 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.183347:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638671.183375:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b48380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3291:x1875523183682176:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638671.183380:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788638671.183428:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7391b4a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183682176:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788638671.183609:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7391b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3294:1875523183682048:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788638671.183969:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788638671.184018:0:14379:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788638671.184026:0:14379:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+3:16509:x1875523183681664:12345-0@lo:104: Request processed in 14159us (14349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638671.184035:0:14379:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788638671.185028:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00010000:00010000:2.0:1788638671.185128:0:14384:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788638671.185138:0:14384:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.134@tcp lock: ffff9c73b5467a00/0xa0b1f1e3b4b2baa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa0b1f1e3b4b2baab expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.185285:0:14384:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467a00 already unused, calling callback (ffffffffc1c9ac20) 10000000:00010000:2.0:1788638671.185291:0:14384:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.134@tcp lock: ffff9c73b5467a00/0xa0b1f1e3b4b2baa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa0b1f1e3b4b2baab expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.185301:0:14384:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.134@tcp lock: ffff9c73b5467a00/0xa0b1f1e3b4b2baa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa0b1f1e3b4b2baab expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788638671.185329:0:14384:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.134@tcp lock: ffff9c73b5467a00/0xa0b1f1e3b4b2baa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa0b1f1e3b4b2baab expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788638671.185335:0:14384:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788638671.185396:0:14384:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.134@tcp lock: ffff9c73b5467a00/0xa0b1f1e3b4b2baa4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2baab expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.185403:0:14384:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788638671.185426:0:14384:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.134@tcp lock: ffff9c73b5467a00/0xa0b1f1e3b4b2baa4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2baab expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.185501:0:14384:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.134@tcp lock: ffff9c73b5467a00/0xa0b1f1e3b4b2baa4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa0b1f1e3b4b2baab expref: -99 pid: 15795 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.185526:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638671.185528:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638671.185529:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638671.185542:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788638671.185562:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7391b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183682304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788638671.185630:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788638671.189673:0:16509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73bc01da00/0xa0b1f1e3b4b2b970 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b969 expref: 18 pid: 14388 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638671.189697:0:16509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7398c2c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16509:1875523183681792:0@lo:104: 00010000:00010000:0.0:1788638671.189716:0:16509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2b923 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2b91c expref: 17 pid: 14388 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638671.189726:0:16509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7398c2ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16509:1875523183681920:0@lo:104: 00000100:00100000:0.0:1788638671.189744:0:16509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7398c2c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16509:1875523183681408:192.168.203.34@tcp:104: 00000100:00100000:0.0:1788638671.189754:0:16509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7398c2dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16509:1875523183681536:192.168.203.34@tcp:104: 00000100:00100000:0.0:1788638671.189764:0:16509:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7398c2f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16509:1875523183681664:0@lo:104: 00010000:00010000:0.0:1788638671.189841:0:16509:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9c73b5467400/0xa0b1f1e3b4b2bc2c lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638671.194728:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174251520 00000100:00100000:3.0:1788638671.194766:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174251520 00010000:00010000:3.0:1788638671.194840:0:14382:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2bc02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143524b expref: 13 pid: 14389 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638671.194885:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183682304 00000100:00100000:3.0:1788638671.194889:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183682304 00010000:00010000:3.0:1788638671.194904:0:14382:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c7385308400/0xa0b1f1e3b4b2baab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2baa4 expref: 17 pid: 14388 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638671.194921:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00100000:3.0:1788638671.194931:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:2365:x1875523174251520:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788638671.194950:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638671.194956:0:14382:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2bc02 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143524b expref: 13 pid: 14389 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638671.194970:0:14382:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2bc02 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143524b expref: 13 pid: 14389 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638671.194994:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2bc02 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143524b expref: 13 pid: 14389 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638671.195014:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638671.195084:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4ea1363-ddd7-45b0-8012-313d4f61213a+12:2365:x1875523174251520:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 155us (10065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638671.195092:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00100000:3.0:1788638671.195152:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788638671.195159:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+17:3291:x1875523183682304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788638671.195168:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638671.195172:0:14382:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c7385308400/0xa0b1f1e3b4b2baab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2baa4 expref: 17 pid: 14388 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638671.195188:0:14382:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c7385308400/0xa0b1f1e3b4b2baab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2baa4 expref: 17 pid: 14388 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638671.195200:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c7385308400/0xa0b1f1e3b4b2baab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa0b1f1e3b4b2baa4 expref: 17 pid: 14388 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638671.195208:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638671.195263:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:3291:x1875523183682304:12345-0@lo:103:ldlm_bl.0 Request processed in 104us (9632us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638671.195270:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788638671.195402:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638671.195866:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174251648 00000100:00100000:2.0:1788638671.195872:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174251648 00010000:00010000:2.0:1788638671.195901:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bbca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14351e9 expref: 12 pid: 14389 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638671.195921:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:2.0:1788638671.195929:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4ea1363-ddd7-45b0-8012-313d4f61213a+12:2364:x1875523174251648:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638671.195939:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638671.195953:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bbca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14351e9 expref: 12 pid: 14389 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.195964:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bbca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14351e9 expref: 12 pid: 14389 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.195980:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bbca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14351e9 expref: 12 pid: 14389 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.195997:0:14380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9c73b5467400/0xa0b1f1e3b4b2bc2c lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.196008:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73b5467400/0xa0b1f1e3b4b2bc2c lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.196028:0:14380:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c73b5467400/0xa0b1f1e3b4b2bc2c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.196036:0:14380:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9c73b5467400/0xa0b1f1e3b4b2bc2c lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.196045:0:14380:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9c73b5467400/0xa0b1f1e3b4b2bc2c lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.196053:0:14380:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9c73b5467400/0xa0b1f1e3b4b2bc2c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.196060:0:14380:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467400 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638671.196066:0:14380:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9c73b5467400/0xa0b1f1e3b4b2bc2c lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.196076:0:14380:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9c73b5467400/0xa0b1f1e3b4b2bc2c lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.196102:0:14380:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9c73b5467400/0xa0b1f1e3b4b2bc2c lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.196115:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638671.196171:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4ea1363-ddd7-45b0-8012-313d4f61213a+11:2364:x1875523174251648:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 242us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638671.196179:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:2.0:1788638671.196260:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7391b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183682304:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788638671.196599:0:16509:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9c73b5467400/0xa0b1f1e3b4b2bc2c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638671.196609:0:16509:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9c73b5467400/0xa0b1f1e3b4b2bc2c lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638671.196616:0:16509:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9c73b5467400/0xa0b1f1e3b4b2bc2c lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16509 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638671.904737:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788638672.415841:0:14391:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788638672.415848:0:14391:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c73bf0eb800 from 10 10000000:01000000:3.0:1788638672.415853:0:14391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788638672.415900:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380030c00/0xa0b1f1e3b4b2bc33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638672.415912:0:14391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7380030c00/0xa0b1f1e3b4b2bc33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638672.415924:0:14391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7380030c00/0xa0b1f1e3b4b2bc33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638672.415948:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387d9e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183682432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788638672.416020:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638672.416076:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73ad646e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788638672.416242:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183682432 00000100:00100000:1.0:1788638672.416250:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183682432 00000100:00100000:1.0:1788638672.416299:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788638672.416308:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+16:14391:x1875523183682432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788638672.416321:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638672.416335:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73b5569600/0xa0b1f1e3b4b2bc3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2bc33 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638672.416357:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73b5569600/0xa0b1f1e3b4b2bc3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bc33 expref: 17 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638672.416369:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73b5569600/0xa0b1f1e3b4b2bc3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bc33 expref: 17 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638672.416378:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5569600, rc 0) 00000100:00100000:1.0:1788638672.416431:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf628450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d97ff07e-b3b5-4ef8-bed3-2a6960653930+17:14391:x1875523183682432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638672.416438:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788638672.416560:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387d9e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183682432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788638672.416576:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7380030c00/0xa0b1f1e3b4b2bc33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bc3a expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638672.416669:0:14391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7380030c00/0xa0b1f1e3b4b2bc33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2bc3a expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638672.416726:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387d9e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183682560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788638672.416758:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638672.416843:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73ad646e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788638672.416891:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183682560 00000100:00100000:1.0:1788638672.417372:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183682560 00000100:00100000:1.0:1788638672.417478:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788638672.417489:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+17:14391:x1875523183682560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788638672.417854:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf628c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+17:14391:x1875523183682560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 367us (1094us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638672.417872:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788638672.418184:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387d9e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183682560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638672.418235:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7398c2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183682688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788638672.419111:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638672.419152:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c738a4bb900 going to sleep for 11 seconds 00000100:00100000:3.0:1788638672.419271:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183682688 00000100:00100000:3.0:1788638672.419278:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183682688 00000100:00100000:3.0:1788638672.419321:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788638672.419330:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf62a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+17:14391:x1875523183682688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788638672.419525:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf62a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+17:14391:x1875523183682688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 195us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638672.419532:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788638672.419881:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7398c2dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183682688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788638672.420825:0:16543:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788638672.422082:0:14391:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788638672.422111:0:14391:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788638672.422121:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380030c00/0xa0b1f1e3b4b2bc33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bc3a expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638672.422133:0:14391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7380030c00/0xa0b1f1e3b4b2bc33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bc3a expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638672.422143:0:14391:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788638672.422146:0:14391:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c73b4524000 from 10 10000000:01000000:3.0:1788638672.422148:0:14391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788638672.422180:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2bc41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638672.422188:0:14391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2bc41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638672.422206:0:14391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2bc41 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638672.422229:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387d9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183682816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788638672.422295:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638672.422334:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73ad646900 going to sleep for 11 seconds 00000100:00100000:3.0:1788638672.422354:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183682816 00000100:00100000:3.0:1788638672.422359:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183682816 00000100:00100000:3.0:1788638672.422399:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788638672.422407:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+17:14391:x1875523183682816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788638672.422419:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638672.422431:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7380030e00/0xa0b1f1e3b4b2bc48 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2bc41 expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638672.422462:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7380030e00/0xa0b1f1e3b4b2bc48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bc41 expref: 18 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638672.422473:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7380030e00/0xa0b1f1e3b4b2bc48 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bc41 expref: 18 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638672.422480:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030e00, rc 0) 00000100:00100000:3.0:1788638672.422513:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf628050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+18:14391:x1875523183682816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638672.422521:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788638672.422564:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387d9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183682816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788638672.422578:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2bc41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bc48 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638672.422594:0:14391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2bc41 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2bc48 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638672.422641:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387d9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183682944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788638672.422668:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638672.422680:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73ad646900 going to sleep for 11 seconds 00000100:00100000:3.0:1788638672.422692:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183682944 00000100:00100000:3.0:1788638672.422695:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183682944 00000100:00100000:3.0:1788638672.422716:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788638672.422721:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c739083e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+18:14391:x1875523183682944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788638672.422967:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c739083e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+18:14391:x1875523183682944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638672.422974:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788638672.423007:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387d9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183682944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788638672.423035:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387d9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183683072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788638672.423070:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638672.423084:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73ad646900 going to sleep for 11 seconds 00000100:00100000:3.0:1788638672.423095:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183683072 00000100:00100000:3.0:1788638672.423098:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183683072 00000100:00100000:3.0:1788638672.423119:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788638672.423124:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c739083e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+18:14391:x1875523183683072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788638672.423246:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c739083e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+18:14391:x1875523183683072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638672.423252:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788638672.423287:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387d9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183683072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788638672.423919:0:16544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788638672.423967:0:14391:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788638672.423983:0:14391:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788638672.423992:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2bc41 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bc48 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638672.424001:0:14391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7380031200/0xa0b1f1e3b4b2bc41 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bc48 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788638672.424009:0:14391:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788638672.424011:0:14391:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9c73908d2000 from 10 10000000:01000000:3.0:1788638672.424013:0:14391:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788638672.424037:0:14391:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2bc4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638672.424044:0:14391:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2bc4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638672.424053:0:14391:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2bc4f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638672.424068:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387d9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183683200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788638672.424105:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638672.424122:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73ad6463c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638672.424137:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183683200 00000100:00100000:3.0:1788638672.424140:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183683200 00000100:00100000:3.0:1788638672.424165:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788638672.424172:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c739083d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+18:14391:x1875523183683200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788638672.424192:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638672.424203:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7380030000/0xa0b1f1e3b4b2bc56 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa0b1f1e3b4b2bc4f expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638672.424220:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7380030000/0xa0b1f1e3b4b2bc56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bc4f expref: 19 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638672.424231:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7380030000/0xa0b1f1e3b4b2bc56 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa0b1f1e3b4b2bc4f expref: 19 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638672.424237:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380030000, rc 0) 00000100:00100000:3.0:1788638672.424267:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c739083d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:14391:x1875523183683200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (162us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638672.424273:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788638672.424306:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387d9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183683200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788638672.424317:0:14391:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2bc4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bc56 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638672.424326:0:14391:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2bc4f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa0b1f1e3b4b2bc56 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638672.424362:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387d9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183683328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788638672.424387:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638672.424399:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73ad6463c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638672.424410:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183683328 00000100:00100000:3.0:1788638672.424413:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183683328 00000100:00100000:3.0:1788638672.424433:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788638672.424439:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c739083c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:14391:x1875523183683328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788638672.424639:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c739083c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:14391:x1875523183683328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 199us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638672.424646:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788638672.424678:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387d9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183683328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788638672.424701:0:14391:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387d9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183683456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788638672.424735:0:14391:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638672.424748:0:14391:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73ad6463c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638672.424758:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183683456 00000100:00100000:3.0:1788638672.424762:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183683456 00000100:00100000:3.0:1788638672.424805:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788638672.424811:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c739083c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:14391:x1875523183683456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788638672.424923:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c739083c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:14391:x1875523183683456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638672.424929:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788638672.424959:0:14391:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387d9e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d97ff07e-b3b5-4ef8-bed3-2a6960653930:14391:1875523183683456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788638672.437398:0:16545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788638672.437492:0:14391:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788638672.437515:0:14391:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.134@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788638672.437527:0:14391:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2bc4f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bc56 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638672.437539:0:14391:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.134@tcp lock: ffff9c7380031400/0xa0b1f1e3b4b2bc4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa0b1f1e3b4b2bc56 expref: -99 pid: 14391 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638672.930215:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638673.169731:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638673.169855:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174251776 00000100:00100000:1.0:1788638673.169867:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174251776 00000100:00100000:1.0:1788638673.169929:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 114 00000100:00100000:1.0:1788638673.169941:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c739083ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+11:13776:x1875523174251776:12345-192.168.203.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788638673.169957:0:14387:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638673.169975:0:14387:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c73b5569800/0xa0b1f1e3b4b2bc5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a143527c expref: -99 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638673.170003:0:14387:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c73b5569800/0xa0b1f1e3b4b2bc5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143527c expref: 12 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638673.170015:0:14387:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c73b5569800/0xa0b1f1e3b4b2bc5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143527c expref: 12 pid: 14387 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638673.170025:0:14387:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5569800, rc 0) 00000100:00100000:1.0:1788638673.170096:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c739083ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+12:13776:x1875523174251776:12345-192.168.203.34@tcp:101:ll_cfg_requeue.0 Request processed in 156us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638673.170880:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 114 00000100:00100000:3.0:1788638673.181008:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638673.181135:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174251904 00000100:00100000:0.0:1788638673.181145:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174251904 00000100:00100000:0.0:1788638673.181198:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 115 00000100:00100000:0.0:1788638673.181208:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+12:13776:x1875523174251904:12345-192.168.203.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638673.181496:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+12:13776:x1875523174251904:12345-192.168.203.34@tcp:501:ll_cfg_requeue.0 Request processed in 288us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638673.181505:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 115 00000100:00100000:0.0:1788638673.186305:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638673.186435:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174252032 00000100:00100000:3.0:1788638673.186454:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174252032 00000100:00100000:3.0:1788638673.186509:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 116 00000100:00100000:3.0:1788638673.186518:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+12:13776:x1875523174252032:12345-192.168.203.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788638673.186743:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+12:13776:x1875523174252032:12345-192.168.203.34@tcp:503:ll_cfg_requeue.0 Request processed in 225us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638673.186752:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 116 00000100:00100000:2.0:1788638673.226983:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638673.227128:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174252160 00000100:00100000:3.0:1788638673.227138:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174252160 00000100:00100000:3.0:1788638673.227193:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 117 00000100:00100000:3.0:1788638673.227202:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea1363-ddd7-45b0-8012-313d4f61213a+12:13776:x1875523174252160:12345-192.168.203.34@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788638673.227217:0:14389:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638673.227235:0:14389:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9c7380031a00/0xa0b1f1e3b4b2bc64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435283 expref: -99 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638673.227263:0:14389:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9c7380031a00/0xa0b1f1e3b4b2bc64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435283 expref: 13 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638673.227275:0:14389:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9c7380031a00/0xa0b1f1e3b4b2bc64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435283 expref: 13 pid: 14389 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638673.227284:0:14389:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7380031a00, rc 0) 00000100:00100000:3.0:1788638673.227344:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:13776:x1875523174252160:12345-192.168.203.34@tcp:101:ll_cfg_requeue.0 Request processed in 143us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638673.227352:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 117 00000100:00100000:2.0:1788638673.238315:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638673.238499:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174252288 00000100:00100000:0.0:1788638673.238517:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174252288 00000100:00100000:0.0:1788638673.238662:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 118 00000100:00100000:0.0:1788638673.238673:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:13776:x1875523174252288:12345-192.168.203.34@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788638673.238959:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:13776:x1875523174252288:12345-192.168.203.34@tcp:501:ll_cfg_requeue.0 Request processed in 287us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638673.238967:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 118 00000100:00100000:0.0:1788638673.249521:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638673.249655:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174252416 00000100:00100000:3.0:1788638673.249667:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174252416 00000100:00100000:3.0:1788638673.249728:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 119 00000100:00100000:3.0:1788638673.249739:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:13776:x1875523174252416:12345-192.168.203.34@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788638673.250733:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:13776:x1875523174252416:12345-192.168.203.34@tcp:503:ll_cfg_requeue.0 Request processed in 991us (1224us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638673.250745:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 119 00000100:00100000:3.0:1788638673.667251:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638673.667291:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638673.667318:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638673.667341:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638673.667357:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638673.667377:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638673.667400:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174252544 00000100:00100000:3.0:1788638673.667415:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174252544 00000100:00100000:3.0:1788638673.667477:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174252928 00000100:00100000:3.0:1788638673.667481:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174252928 00000100:00100000:1.0:1788638673.667750:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174252800 00000100:00100000:1.0:1788638673.667755:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174252800 00000100:00100000:1.0:1788638673.667778:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174253056 00000100:00100000:1.0:1788638673.667807:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174253056 00000100:00100000:1.0:1788638673.667823:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174252672 00000100:00100000:1.0:1788638673.667826:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174252672 00000100:00100000:1.0:1788638673.667837:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174253184 00000100:00100000:1.0:1788638673.667840:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174253184 00000100:00100000:1.0:1788638673.667871:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:1.0:1788638673.667879:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a963600-85ae-4d04-99fd-4389bf419479+5:2366:x1875523174252800:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638673.667947:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a963600-85ae-4d04-99fd-4389bf419479+5:2366:x1875523174252800:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 67us (654us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638673.667955:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:1.0:1788638673.667970:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:1.0:1788638673.667976:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6181e191-5f1a-46ec-b515-69664fc84af5+5:2366:x1875523174253056:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638673.667998:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6181e191-5f1a-46ec-b515-69664fc84af5+5:2366:x1875523174253056:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 23us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638673.668004:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:1.0:1788638673.668014:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 11 00000100:00100000:1.0:1788638673.668019:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a963600-85ae-4d04-99fd-4389bf419479+5:2366:x1875523174252672:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638673.668037:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a963600-85ae-4d04-99fd-4389bf419479+5:2366:x1875523174252672:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 18us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638673.668042:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 11 00000100:00100000:1.0:1788638673.668051:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00100000:1.0:1788638673.668057:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6181e191-5f1a-46ec-b515-69664fc84af5+5:2366:x1875523174253184:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638673.668074:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6181e191-5f1a-46ec-b515-69664fc84af5+5:2366:x1875523174253184:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 18us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638673.668080:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00080000:1.0:1788638673.668096:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788638673.668100:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788638673.668102:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788638673.668184:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 24 00000100:00100000:3.0:1788638673.668192:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a963600-85ae-4d04-99fd-4389bf419479+6:2366:x1875523174252544:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638673.668221:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a963600-85ae-4d04-99fd-4389bf419479+6:2366:x1875523174252544:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 31us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638673.668239:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 24 00000100:00100000:3.0:1788638673.668251:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 25 00000100:00100000:3.0:1788638673.668257:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6181e191-5f1a-46ec-b515-69664fc84af5+6:2366:x1875523174252928:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638673.668278:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6181e191-5f1a-46ec-b515-69664fc84af5+6:2366:x1875523174252928:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 22us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638673.668284:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 25 00010000:00010000:2.0:1788638673.951949:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638674.656167:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183683584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788638674.656259:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638674.656413:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183683584 00000100:00100000:3.0:1788638674.656427:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183683584 00000100:00100000:3.0:1788638674.656498:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788638674.656507:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183683584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788638674.656547:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788638674.656602:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7d05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183683584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638674.656609:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788638674.656666:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387d9fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183683584:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788638674.656983:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788638674.976368:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638675.153183:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638675.153296:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174253312 00000100:00100000:0.0:1788638675.153305:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174253312 00000100:00100000:0.0:1788638675.153381:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 15 00000100:00100000:0.0:1788638675.153392:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+6:14434:x1875523174253312:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788638675.153412:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638675.153442:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bc6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143528a expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.153510:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bc72 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.153524:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bc72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.153536:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bc72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.153550:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bc79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.153589:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bc79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.153598:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bc79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.153947:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467600/0xa0b1f1e3b4b2bc80 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.153956:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467600/0xa0b1f1e3b4b2bc80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.153964:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467600/0xa0b1f1e3b4b2bc80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638675.153990:0:14397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788638675.153993:0:14397:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638675.154028:0:14397:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467600/0xa0b1f1e3b4b2bc80 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.154040:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bc72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.154046:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bc72 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.154053:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bc72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.154059:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638675.154063:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bc72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.154077:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bc72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.154089:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a62bfc00) 00010000:00010000:0.0:1788638675.154092:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638675.154097:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bc72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.154104:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bc72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.154117:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bc79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.154124:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bc79 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.154143:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bc79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.154149:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638675.154152:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bc79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.154158:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bc79 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.154165:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9c73a62bf800) 00010000:00010000:0.0:1788638675.154168:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638675.154171:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bc79 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.154186:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bc79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.154222:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bc6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143528a expref: 8 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.154236:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467600/0xa0b1f1e3b4b2bc80 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143528a expref: 7 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.154243:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c73a62bf500) 00010000:00010000:0.0:1788638675.154246:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788638675.154248:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5467600, rc 0) 00000100:00100000:0.0:1788638675.154311:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+7:14434:x1875523174253312:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 921us (1139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638675.154319:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 15 00000100:00080000:1.0:1788638675.154824:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638675.165357:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638675.165700:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174253568 00000100:00100000:3.0:1788638675.165710:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174253568 00000100:00100000:3.0:1788638675.165775:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 16 00000100:00100000:3.0:1788638675.165813:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+7:14434:x1875523174253568:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788638675.165832:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638675.165853:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030a00/0xa0b1f1e3b4b2bc87 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435291 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.165919:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2bc8e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.165933:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2bc8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.165946:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2bc8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.165959:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bc95 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.165983:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bc95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.165990:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bc95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.166285:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc600/0xa0b1f1e3b4b2bc9c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.166294:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc600/0xa0b1f1e3b4b2bc9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.166301:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc600/0xa0b1f1e3b4b2bc9c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638675.166310:0:14395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00000100:00100000:1.0:1788638675.168104:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183683968:0@lo:400:kworker.0 00000100:00100000:1.0:1788638675.168170:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638675.168231:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788638675.168237:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183683840:0@lo:400:kworker.0 00000100:00100000:1.0:1788638675.168258:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638675.168273:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1875523183684352:0@lo:400:kworker.0 00000100:00100000:1.0:1788638675.168299:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638675.168327:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183683968 00000100:00100000:1.0:1788638675.168334:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183683968 00000100:00100000:1.0:1788638675.168380:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183683840 00000100:00100000:1.0:1788638675.168382:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183683840 00000100:00100000:1.0:1788638675.168410:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788638675.168418:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183683968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638675.168482:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7d06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183683968:12345-0@lo:400:kworker.0 Request processed in 65us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638675.168489:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788638675.168505:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788638675.168511:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183683840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638675.168551:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7d07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3292:x1875523183683840:12345-0@lo:400:kworker.0 Request processed in 39us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638675.168557:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788638675.168579:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183684352 00000100:00100000:1.0:1788638675.168582:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183684352 00000100:00100000:1.0:1788638675.168607:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788638675.168626:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875523183684352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638675.168658:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7d06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875523183684352:12345-0@lo:400:kworker.0 Request processed in 32us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638675.168664:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:1.0:1788638675.168691:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788638675.168696:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788638675.168724:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183683840:0@lo:400:kworker.0 00000100:00100000:1.0:1788638675.168734:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1875523183684352:0@lo:400:kworker.0 00000100:00100000:1.0:1788638675.168742:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d05f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3292:1875523183683968:0@lo:400:kworker.0 00000100:00100000:1.0:1788638675.168779:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183684096:0@lo:400:kworker.0 00000100:00100000:1.0:1788638675.168831:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638675.168852:0:3293:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788638675.168858:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3293:1875523183683712:0@lo:400:kworker.0 00000100:00100000:1.0:1788638675.168880:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638675.168898:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183684224:0@lo:400:kworker.0 00000100:00100000:1.0:1788638675.168931:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638675.168953:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183684096 00000100:00100000:1.0:1788638675.168956:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183684096 00000100:00100000:1.0:1788638675.168971:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183684224 00000100:00100000:1.0:1788638675.168974:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183684224 00000100:00100000:1.0:1788638675.168990:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788638675.168994:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183684096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638675.169024:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7d05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3293:x1875523183684096:12345-0@lo:400:kworker.0 Request processed in 29us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638675.169031:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788638675.169047:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788638675.169053:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183684224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638675.169078:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7d04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3293:x1875523183684224:12345-0@lo:400:kworker.0 Request processed in 25us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638675.169083:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1788638675.169096:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788638675.169117:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d05c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3293:1875523183684224:0@lo:400:kworker.0 00000100:00100000:1.0:1788638675.169126:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3293:1875523183684096:0@lo:400:kworker.0 00000100:00100000:2.0:1788638675.169237:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788638675.169247:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7391b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183684480:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788638675.169279:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638675.169307:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183684480 00000100:00100000:2.0:1788638675.169311:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183684480 00000100:00100000:2.0:1788638675.169335:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788638675.169341:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183684480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788638675.169367:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788638675.169400:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b49c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183684480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638675.169406:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788638675.169448:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7391b48a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183684480:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788638675.170209:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2bc8e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.170222:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2bc8e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.170230:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2bc8e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.170235:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7380031e00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638675.170240:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2bc8e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.170247:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2bc8e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.170276:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9c73a62bf500) 00010000:00010000:3.0:1788638675.170279:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638675.170284:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2bc8e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.170291:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380031e00/0xa0b1f1e3b4b2bc8e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.170304:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bc95 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.170310:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bc95 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.170315:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bc95 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.170320:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fd200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638675.170323:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bc95 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.170328:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bc95 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.170335:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9c7393e81900) 00010000:00010000:3.0:1788638675.170337:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638675.170340:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bc95 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.170345:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bc95 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638675.170652:0:14388:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183683712 00000100:00100000:0.0:1788638675.170660:0:14388:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183683712 00000100:00100000:0.0:1788638675.170713:0:14388:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788638675.170721:0:14388:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3293:x1875523183683712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638675.170810:0:14388:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3293:x1875523183683712:12345-0@lo:400:kworker.0 Request processed in 89us (1928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638675.170818:0:14388:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788638675.170866:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d04e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3293:1875523183683712:0@lo:400:kworker.0 00010000:00010000:3.0:1788638675.172294:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7380030a00/0xa0b1f1e3b4b2bc87 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435291 expref: 10 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.172320:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc600/0xa0b1f1e3b4b2bc9c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435291 expref: 9 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.172329:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7393e81800) 00010000:00010000:3.0:1788638675.172331:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638675.172335:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73813fc600, rc 0) 00000100:00100000:3.0:1788638675.174259:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+9:14434:x1875523174253568:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 8465us (8900us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788638675.174271:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 16 00000100:00100000:2.0:1788638675.199845:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638675.199947:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174253696 00000100:00100000:1.0:1788638675.199958:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174253696 00000100:00100000:1.0:1788638675.200027:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 17 00000100:00100000:1.0:1788638675.200038:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+9:14434:x1875523174253696:12345-192.168.203.34@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788638675.200146:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b48a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+9:14434:x1875523174253696:12345-192.168.203.34@tcp:59:lhsmtool_posix.0 Request processed in 110us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638675.200154:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 17 00000100:00100000:2.0:1788638675.259269:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638675.260469:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174253824 00000100:00100000:0.0:1788638675.260482:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174253824 00000100:00100000:0.0:1788638675.260562:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 18 00000100:00100000:0.0:1788638675.260571:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+9:14440:x1875523174253824:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638675.260591:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638675.260613:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bcaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435298 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.260687:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bcb1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.260703:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bcb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.260713:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bcb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.260727:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bcb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.260733:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bcb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.260741:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bcb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.260954:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bcb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.260961:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bcb1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.260967:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bcb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.260981:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638675.260985:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bcb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.260993:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bcb1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.261004:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a62bfc00) 00010000:00010000:0.0:1788638675.261006:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638675.261011:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bcb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.261016:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bcb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.261026:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bcb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.261031:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bcb8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.261036:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bcb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.261040:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638675.261042:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bcb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.261046:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bcb8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.261061:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c73a62bf800) 00010000:00010000:0.0:1788638675.261063:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638675.261065:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bcb8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.261070:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bcb8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.261099:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bcaa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435298 expref: 10 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.261109:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a62bfc00) 00010000:00010000:0.0:1788638675.261111:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638675.261115:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bcaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435298 expref: 10 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.261124:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5466a00, rc 0) 00000100:00100000:0.0:1788638675.261191:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b48380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+9:14440:x1875523174253824:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 620us (1928us total) trans 0 rc 301/301 00000100:00100000:0.0:1788638675.261199:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 18 00000100:00100000:3.0:1788638675.286181:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638675.286312:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174253952 00000100:00100000:2.0:1788638675.286323:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174253952 00000100:00100000:2.0:1788638675.286381:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 0 00000100:00100000:2.0:1788638675.286400:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0a963600-85ae-4d04-99fd-4389bf419479+9:14440:x1875523174253952:12345-192.168.203.34@tcp:700:lfs.0 00000100:00100000:2.0:1788638675.286491:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:0a963600-85ae-4d04-99fd-4389bf419479+9:14440:x1875523174253952:12345-192.168.203.34@tcp:700:lfs.0 Request processed in 102us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638675.286499:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 0 00000100:00100000:2.0:1788638675.290427:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638675.290535:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174254208 00000100:00100000:1.0:1788638675.290545:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174254208 00000100:00100000:1.0:1788638675.290604:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 19 00000100:00100000:1.0:1788638675.290615:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+9:14440:x1875523174254208:12345-192.168.203.34@tcp:36:lfs.0 00010000:00010000:1.0:1788638675.290668:0:16245:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638675.290697:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2bbed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435213 expref: 9 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638675.290717:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a62bfc00) 00010000:00010000:1.0:1788638675.290723:0:16245:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788638675.290996:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2bcbf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638675.291011:0:16245:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2bc25 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435275 expref: 5 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638675.291019:0:16245:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2bcbf lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638675.291053:0:16245:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2bc25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435275 expref: 5 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638675.291066:0:16245:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2bc25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435275 expref: 5 pid: 14397 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638675.291079:0:16245:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d04380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16245:1875523183684608:192.168.203.34@tcp:104: 00000100:00100000:1.0:1788638675.291176:0:16245:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73ad4ddb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788638675.294494:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638675.294589:0:16245:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d04380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16245:1875523183684608:192.168.203.34@tcp:104: 00010000:00010000:1.0:1788638675.294615:0:16245:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2bcbf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638675.294743:0:14380:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174254336 00000100:00100000:2.0:1788638675.294751:0:14380:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174254336 00010000:00010000:2.0:1788638675.294848:0:14380:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2bc25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435275 expref: 6 pid: 14397 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638675.294880:0:14380:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:2.0:1788638675.294890:0:14380:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6181e191-5f1a-46ec-b515-69664fc84af5+6:2365:x1875523174254336:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788638675.294906:0:14380:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788638675.294913:0:14380:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2bc25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435275 expref: 6 pid: 14397 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.294926:0:14380:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2bc25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435275 expref: 6 pid: 14397 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.294948:0:14380:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2bc25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435275 expref: 6 pid: 14397 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.294963:0:14380:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a62bfc00) 00010000:00010000:2.0:1788638675.294980:0:14380:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2bcbf lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.294989:0:14380:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2bcbf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.294996:0:14380:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2bcbf lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.295034:0:14380:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788638675.295081:0:14380:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6181e191-5f1a-46ec-b515-69664fc84af5+5:2365:x1875523174254336:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 192us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638675.295089:0:14380:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 9 00010000:00010000:0.0:1788638675.295218:0:16245:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2bcbf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.295226:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2bcbf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.295249:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bcc6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.295268:0:16245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bcc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.295276:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bcc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788638675.297118:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1788638675.297337:0:16245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788638675.297351:0:16245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2bcbf lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.297361:0:16245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2bcbf lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.297368:0:16245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2bcbf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.297374:0:16245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5568600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638675.297379:0:16245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2bcbf lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.297388:0:16245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2bcbf lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.297403:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a62bfc00) 00010000:00010000:0.0:1788638675.297406:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638675.297410:0:16245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2bcbf lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.297415:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2bcbf lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788638675.297704:0:16245:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018287cc7 reply state 0000000064f75ea5 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bcc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638675.297713:0:16245:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788638675.299293:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+10:14440:x1875523174254208:12345-192.168.203.34@tcp:36:lfs.0 Request processed in 8671us (8867us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788638675.299304:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 19 00010000:00010000:2.0:1788638675.319619:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bcc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.319636:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bcc6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.319645:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bcc6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.319650:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467a00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638675.319655:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bcc6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.319663:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bcc6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.319745:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c73a62bf800) 00010000:00010000:2.0:1788638675.319748:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638675.319767:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bcc6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.319774:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bcc6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638675.408016:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638675.408282:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174254464 00000100:00100000:0.0:1788638675.408292:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174254464 00000100:00100000:0.0:1788638675.408352:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 20 00000100:00100000:0.0:1788638675.408362:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+9:14448:x1875523174254464:12345-192.168.203.34@tcp:101:lctl.0 00010000:00010000:0.0:1788638675.408387:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638675.408421:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bccd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143529f expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.408496:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466000/0xa0b1f1e3b4b2bcd4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.408510:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466000/0xa0b1f1e3b4b2bcd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.408522:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466000/0xa0b1f1e3b4b2bcd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638675.408555:0:14397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788638675.408559:0:14397:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638675.408593:0:14397:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466000/0xa0b1f1e3b4b2bcd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.408635:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bccd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143529f expref: 11 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.408654:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466000/0xa0b1f1e3b4b2bcd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143529f expref: 10 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.408662:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a62bfc00) 00010000:00010000:0.0:1788638675.408665:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788638675.408668:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5466000, rc 0) 00000100:00100000:0.0:1788638675.408916:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+10:14448:x1875523174254464:12345-192.168.203.34@tcp:101:lctl.0 Request processed in 555us (909us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638675.408924:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 20 00000100:00100000:3.0:1788638675.441750:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638675.442628:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174254592 00000100:00100000:2.0:1788638675.442639:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174254592 00000100:00100000:2.0:1788638675.442751:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 21 00000100:00100000:2.0:1788638675.442772:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6181e191-5f1a-46ec-b515-69664fc84af5+5:14449:x1875523174254592:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:2.0:1788638675.442816:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638675.442839:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bcdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14352a6 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.442904:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2bce2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.442918:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2bce2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.442932:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2bce2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638675.442967:0:14396:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788638675.442970:0:14396:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788638675.442990:0:14396:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2bce2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.443011:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bcdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352a6 expref: 7 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.443044:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6000/0xa0b1f1e3b4b2bce2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352a6 expref: 6 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.443052:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a62bfc00) 00010000:00010000:2.0:1788638675.443055:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788638675.443058:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa6000, rc 0) 00000100:00100000:2.0:1788638675.443118:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6181e191-5f1a-46ec-b515-69664fc84af5+6:14449:x1875523174254592:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 359us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638675.443125:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 21 00000100:00100000:2.0:1788638675.450081:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638675.450158:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174254720 00000100:00100000:3.0:1788638675.450168:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174254720 00000100:00100000:3.0:1788638675.450216:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 22 00000100:00100000:3.0:1788638675.450226:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c738537b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6181e191-5f1a-46ec-b515-69664fc84af5+6:14449:x1875523174254720:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:3.0:1788638675.450245:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638675.450264:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bce9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14352ad expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.450324:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fcc00/0xa0b1f1e3b4b2bcf0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.450340:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fcc00/0xa0b1f1e3b4b2bcf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.450366:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fcc00/0xa0b1f1e3b4b2bcf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.450381:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2bcf7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.450389:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2bcf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.450396:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2bcf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.450556:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fce00/0xa0b1f1e3b4b2bcfe lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.450566:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fce00/0xa0b1f1e3b4b2bcfe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.450574:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fce00/0xa0b1f1e3b4b2bcfe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638675.450600:0:14395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788638675.450604:0:14395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788638675.450622:0:14395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fce00/0xa0b1f1e3b4b2bcfe lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.450634:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fcc00/0xa0b1f1e3b4b2bcf0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.450640:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fcc00/0xa0b1f1e3b4b2bcf0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.450657:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fcc00/0xa0b1f1e3b4b2bcf0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.450662:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fcc00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638675.450666:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fcc00/0xa0b1f1e3b4b2bcf0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.450675:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fcc00/0xa0b1f1e3b4b2bcf0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.450686:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a62bfc00) 00010000:00010000:3.0:1788638675.450690:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638675.450694:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fcc00/0xa0b1f1e3b4b2bcf0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.450701:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fcc00/0xa0b1f1e3b4b2bcf0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.450715:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2bcf7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.450720:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2bcf7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.450725:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2bcf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.450730:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fc200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638675.450733:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2bcf7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.450748:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2bcf7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.450755:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c7393e81900) 00010000:00010000:3.0:1788638675.450757:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638675.450760:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2bcf7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.450766:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2bcf7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.451069:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bce9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352ad expref: 8 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.451087:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fce00/0xa0b1f1e3b4b2bcfe lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352ad expref: 7 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.451094:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c7393e81b00) 00010000:00010000:3.0:1788638675.451096:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788638675.451099:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73813fce00, rc 0) 00000100:00100000:3.0:1788638675.451259:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c738537b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6181e191-5f1a-46ec-b515-69664fc84af5+7:14449:x1875523174254720:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 1034us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638675.451267:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 22 00000100:00100000:3.0:1788638675.458095:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638675.458184:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174254976 00000100:00100000:0.0:1788638675.458195:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174254976 00000100:00100000:0.0:1788638675.458254:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 23 00000100:00100000:0.0:1788638675.458264:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6181e191-5f1a-46ec-b515-69664fc84af5+7:14449:x1875523174254976:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638675.458285:0:16245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638675.458307:0:16245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14352b4 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638675.458405:0:16245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788638675.458536:0:16245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd05 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352b4 expref: 9 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.458552:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a62bfc00) 00010000:00010000:0.0:1788638675.458555:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788638675.458573:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352b4 expref: 9 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.458588:0:16245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5466c00, rc 0) 00000100:00100000:0.0:1788638675.458657:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6181e191-5f1a-46ec-b515-69664fc84af5+8:14449:x1875523174254976:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 393us (569us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1788638675.458664:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 23 00000100:00100000:2.0:1788638675.461754:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638675.461869:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174255232 00000100:00100000:0.0:1788638675.461878:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174255232 00000100:00100000:0.0:1788638675.461933:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 24 00000100:00100000:0.0:1788638675.461943:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6181e191-5f1a-46ec-b515-69664fc84af5+8:14449:x1875523174255232:12345-192.168.203.34@tcp:36:lfs.0 00010000:00010000:0.0:1788638675.461993:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638675.462017:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fce00/0xa0b1f1e3b4b2bcfe lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352ad expref: 8 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.462037:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c7393e81b00) 00010000:00010000:0.0:1788638675.462048:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788638675.462070:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd13 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.462083:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.462092:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788638675.462286:0:14397:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4715b0c reply state 00000000f5d2f036 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638675.462296:0:14397:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788638675.462316:0:14397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788638675.462401:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6181e191-5f1a-46ec-b515-69664fc84af5+9:14449:x1875523174255232:12345-192.168.203.34@tcp:36:lfs.0 Request processed in 459us (656us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788638675.462408:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 24 00010000:00010000:2.0:1788638675.464356:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd13 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.464372:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd13 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.464379:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd13 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.464384:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638675.464389:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd13 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.464407:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd13 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.464423:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c73a62bf900) 00010000:00010000:2.0:1788638675.464447:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788638675.464454:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd13 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.464460:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd13 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638675.465077:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638675.465136:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174255488 00000100:00100000:0.0:1788638675.465145:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174255488 00000100:00100000:0.0:1788638675.465193:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 2 00000100:00100000:0.0:1788638675.465203:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6181e191-5f1a-46ec-b515-69664fc84af5+8:14449:x1875523174255488:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:0.0:1788638675.465408:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6181e191-5f1a-46ec-b515-69664fc84af5+9:14449:x1875523174255488:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 206us (334us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788638675.465417:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 2 00000100:00100000:1.0:1788638675.477956:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638675.478995:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174255744 00000100:00100000:0.0:1788638675.479015:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174255744 00000100:00100000:0.0:1788638675.479136:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 25 00000100:00100000:0.0:1788638675.479148:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6181e191-5f1a-46ec-b515-69664fc84af5+9:14449:x1875523174255744:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638675.479172:0:16245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638675.479194:0:16245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd1a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14352bb expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.479267:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2bd21 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.479283:0:16245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2bd21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.479295:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2bd21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.479309:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd28 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.479330:0:16245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.479338:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638675.479462:0:16245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788638675.479564:0:16245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2bd21 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.479581:0:16245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2bd21 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.479588:0:16245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2bd21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.479594:0:16245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638675.479598:0:16245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2bd21 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.479605:0:16245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2bd21 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.479618:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a62bfc00) 00010000:00010000:0.0:1788638675.479621:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638675.479625:0:16245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2bd21 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.479641:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2bd21 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.479670:0:16245:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd28 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.479677:0:16245:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd28 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.479683:0:16245:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.479688:0:16245:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638675.479691:0:16245:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd28 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.479697:0:16245:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd28 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.479705:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c73a62bf300) 00010000:00010000:0.0:1788638675.479708:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638675.479711:0:16245:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd28 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.479717:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd28 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.479752:0:16245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd1a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352bb expref: 11 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.479762:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a62bfc00) 00010000:00010000:0.0:1788638675.479765:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788638675.479775:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd1a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352bb expref: 11 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.479821:0:16245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5466c00, rc 0) 00000100:00100000:0.0:1788638675.479887:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7d04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6181e191-5f1a-46ec-b515-69664fc84af5+10:14449:x1875523174255744:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 742us (1939us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788638675.479895:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 25 00000100:00100000:2.0:1788638675.482960:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638675.483051:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174255872 00000100:00100000:0.0:1788638675.483062:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174255872 00000100:00100000:0.0:1788638675.483119:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 26 00000100:00100000:0.0:1788638675.483129:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6181e191-5f1a-46ec-b515-69664fc84af5+10:14449:x1875523174255872:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638675.483150:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638675.483172:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bd36 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14352c2 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.483255:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2bd3d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.483269:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2bd3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.483291:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2bd3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638675.483313:0:14397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788638675.483316:0:14397:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638675.483331:0:14397:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2bd3d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.483355:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bd36 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352c2 expref: 12 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.483401:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2bd3d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352c2 expref: 11 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.483411:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c73a62bf100) 00010000:00010000:0.0:1788638675.483414:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788638675.483417:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5466600, rc 0) 00000100:00100000:0.0:1788638675.483480:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6181e191-5f1a-46ec-b515-69664fc84af5+11:14449:x1875523174255872:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 352us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638675.483487:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 26 00000100:00100000:3.0:1788638675.489953:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638675.490532:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174256000 00000100:00100000:0.0:1788638675.490543:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174256000 00000100:00100000:0.0:1788638675.490642:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 3 00000100:00100000:0.0:1788638675.490653:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6181e191-5f1a-46ec-b515-69664fc84af5+11:14449:x1875523174256000:12345-192.168.203.34@tcp:37:lfs.0 00000100:00100000:0.0:1788638675.496379:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6181e191-5f1a-46ec-b515-69664fc84af5+11:14449:x1875523174256000:12345-192.168.203.34@tcp:37:lfs.0 Request processed in 5706us (6413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638675.496393:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 3 00000100:00100000:2.0:1788638675.501518:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638675.501603:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174256256 00000100:00100000:3.0:1788638675.501613:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174256256 00000100:00100000:3.0:1788638675.501676:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 4 00000100:00100000:3.0:1788638675.501702:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d45450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6181e191-5f1a-46ec-b515-69664fc84af5+11:14449:x1875523174256256:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:3.0:1788638675.502025:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d45450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6181e191-5f1a-46ec-b515-69664fc84af5+12:14449:x1875523174256256:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 324us (516us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788638675.502034:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 4 00000100:00100000:3.0:1788638675.589619:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638675.590030:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174256384 00000100:00100000:2.0:1788638675.590041:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174256384 00000100:00100000:2.0:1788638675.590201:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 27 00000100:00100000:2.0:1788638675.590212:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a963600-85ae-4d04-99fd-4389bf419479+10:14455:x1875523174256384:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:2.0:1788638675.590232:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638675.590254:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2bd44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14352c9 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590318:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bd4b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590332:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bd4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590343:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bd4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590355:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2bd52 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590361:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2bd52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590393:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2bd52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590502:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2bd59 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590522:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2bd59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590529:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2bd59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638675.590559:0:14396:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788638675.590562:0:14396:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788638675.590597:0:14396:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2bd59 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590610:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bd4b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590616:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bd4b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590623:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bd4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590629:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638675.590642:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bd4b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590649:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bd4b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590668:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a62bfc00) 00010000:00010000:2.0:1788638675.590671:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638675.590676:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bd4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590682:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bd4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590695:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2bd52 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590701:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2bd52 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590707:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2bd52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590713:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638675.590716:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2bd52 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590721:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2bd52 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590728:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9c738a6e9700) 00010000:00010000:2.0:1788638675.590730:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638675.590733:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2bd52 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590739:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2bd52 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590829:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2bd44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352c9 expref: 12 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590845:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7000/0xa0b1f1e3b4b2bd59 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352c9 expref: 11 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.590852:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c73a62bf100) 00010000:00010000:2.0:1788638675.590854:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788638675.590857:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7000, rc 0) 00000100:00100000:2.0:1788638675.590921:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a963600-85ae-4d04-99fd-4389bf419479+11:14455:x1875523174256384:12345-192.168.203.34@tcp:101:bash.0 Request processed in 711us (1311us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638675.590929:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 27 00000100:00100000:2.0:1788638675.595754:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638675.595880:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174256640 00000100:00100000:0.0:1788638675.595890:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174256640 00000100:00100000:0.0:1788638675.595951:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 28 00000100:00100000:0.0:1788638675.595961:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+11:14455:x1875523174256640:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:0.0:1788638675.595981:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638675.596000:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bd60 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14352d0 expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.596377:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd67 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.596415:0:14397:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2bd3d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352c2 expref: 11 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.596625:0:14397:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd67 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.596662:0:14397:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2bd3d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352c2 expref: 11 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.596678:0:14397:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2bd3d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352c2 expref: 11 pid: 14397 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638675.596693:0:14397:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7398c2c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14397:1875523183684736:192.168.203.34@tcp:104: 00000100:00100000:0.0:1788638675.596816:0:14397:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7398edd240 going to sleep for 11 seconds 00000100:00100000:0.0:1788638675.599215:0:14397:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7398c2c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14397:1875523183684736:192.168.203.34@tcp:104: 00010000:00010000:0.0:1788638675.599245:0:14397:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd67 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638675.601213:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638675.601657:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174256768 00000100:00100000:1.0:1788638675.601676:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174256768 00010000:00010000:1.0:1788638675.601715:0:14381:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2bd3d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352c2 expref: 12 pid: 14397 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638675.601757:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:1.0:1788638675.601821:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6181e191-5f1a-46ec-b515-69664fc84af5+12:2365:x1875523174256768:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638675.601839:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638675.601846:0:14381:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2bd3d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352c2 expref: 12 pid: 14397 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638675.601861:0:14381:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2bd3d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352c2 expref: 12 pid: 14397 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638675.601881:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466600/0xa0b1f1e3b4b2bd3d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352c2 expref: 12 pid: 14397 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638675.601896:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c73a62bf100) 00010000:00010000:1.0:1788638675.601900:0:14381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd67 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638675.601909:0:14381:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd67 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638675.601916:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd67 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638675.601937:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638675.601995:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6181e191-5f1a-46ec-b515-69664fc84af5+11:2365:x1875523174256768:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 176us (789us total) trans 0 rc 0/0 00010000:00010000:0.0:1788638675.605295:0:14397:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd67 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.605312:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd67 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.605346:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd6e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.605358:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd6e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.605384:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd6e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.608318:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2bd75 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.608340:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2bd75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.608353:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2bd75 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638675.608365:0:14397:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788638675.608410:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd67 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.608418:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd67 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.608424:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd67 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.608439:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:0.0:1788638675.608443:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd67 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.608450:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd67 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.608462:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c73a62bf100) 00010000:00010000:0.0:1788638675.608466:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788638675.608485:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd67 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.608493:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd67 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788638675.608508:0:14397:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c16c7efb reply state 00000000a60b8d0b transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd6e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638675.608517:0:14397:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788638675.608556:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bd60 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352d0 expref: 14 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.608570:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2bd75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352d0 expref: 13 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.608576:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c73a62bfd00) 00010000:00010000:0.0:1788638675.608578:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788638675.608581:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5467c00, rc 0) 00000100:00100000:0.0:1788638675.608649:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+14:14455:x1875523174256640:12345-192.168.203.34@tcp:101:bash.0 Request processed in 12688us (12904us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788638675.608657:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 28 00000100:00100000:1.0:1788638675.613196:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 10 00010000:00010000:3.0:1788638675.613240:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd6e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.613253:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd6e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.613262:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd6e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.613268:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638675.613273:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd6e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.613281:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd6e lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.613296:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9c73a62bf300) 00010000:00010000:3.0:1788638675.613300:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788638675.613305:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd6e lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.613312:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466800/0xa0b1f1e3b4b2bd6e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638675.626748:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638675.626900:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174256896 00000100:00100000:0.0:1788638675.626909:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174256896 00000100:00100000:0.0:1788638675.626971:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 29 00000100:00100000:0.0:1788638675.626982:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+13:14455:x1875523174256896:12345-192.168.203.34@tcp:101:bash.0 00010000:00010000:0.0:1788638675.627014:0:16245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638675.627036:0:16245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bd83 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14352d7 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.627113:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd8a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.627127:0:16245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.627138:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638675.627177:0:16245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788638675.627181:0:16245:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788638675.627201:0:16245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.627210:0:16245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd8a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.627233:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bd83 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352d7 expref: 15 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.627250:0:16245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352d7 expref: 14 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.627259:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c73a62bfd00) 00010000:00010000:0.0:1788638675.627261:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788638675.627265:0:16245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5466c00, rc 0) 00000100:00100000:0.0:1788638675.627323:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+14:14455:x1875523174256896:12345-192.168.203.34@tcp:101:bash.0 Request processed in 343us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638675.627331:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 29 00000100:00100000:2.0:1788638675.630860:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638675.631730:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174257152 00000100:00100000:3.0:1788638675.631740:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174257152 00000100:00100000:3.0:1788638675.631837:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 5 00000100:00100000:3.0:1788638675.631848:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a963600-85ae-4d04-99fd-4389bf419479+14:14455:x1875523174257152:12345-192.168.203.34@tcp:35:bash.0 00000100:00100000:3.0:1788638675.632195:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a963600-85ae-4d04-99fd-4389bf419479+15:14455:x1875523174257152:12345-192.168.203.34@tcp:35:bash.0 Request processed in 348us (1342us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788638675.632203:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 5 00000040:00080000:3.0:1788638675.680627:0:14429:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788638675.754568:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638675.756222:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174257408 00000100:00100000:3.0:1788638675.756236:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174257408 00000100:00100000:3.0:1788638675.756493:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 30 00000100:00100000:3.0:1788638675.756506:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+15:14465:x1875523174257408:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:3.0:1788638675.756530:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638675.756550:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2bd91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14352de expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638675.756633:0:14395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788638675.756878:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2bd91 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352de expref: 17 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.756893:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9c73a62bfc00) 00010000:00010000:3.0:1788638675.756896:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788638675.756901:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2bd91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352de expref: 17 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.756916:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73813fc200, rc 0) 00000100:00100000:3.0:1788638675.756977:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+16:14465:x1875523174257408:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 474us (2417us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788638675.756994:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 30 00000100:00100000:2.0:1788638675.768215:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638675.768322:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174257664 00000100:00100000:3.0:1788638675.768333:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174257664 00000100:00100000:3.0:1788638675.768777:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00100000:3.0:1788638675.768823:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a963600-85ae-4d04-99fd-4389bf419479+16:14465:x1875523174257664:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:3.0:1788638675.769047:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a963600-85ae-4d04-99fd-4389bf419479+17:14465:x1875523174257664:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 228us (841us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788638675.769055:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 6 00000001:00080000:1.0:1788638675.777449:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934600 is committed 00000001:00080000:1.0:1788638675.777465:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:1.0:1788638675.777555:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934601 is committed 00000001:00080000:1.0:1788638675.777573:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:2.0:1788638675.802290:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638675.802501:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174257920 00000100:00100000:0.0:1788638675.802519:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174257920 00000100:00100000:0.0:1788638675.802675:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 31 00000100:00100000:0.0:1788638675.802740:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+13:14468:x1875523174257920:12345-192.168.203.34@tcp:101:lfs.0 00010000:00010000:0.0:1788638675.802763:0:16245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788638675.802821:0:16245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bd9f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14352e5 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.802910:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bda6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.802924:0:16245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bda6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.802936:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bda6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788638675.802945:0:16245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788638675.803152:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467a00/0xa0b1f1e3b4b2bd9f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352e5 expref: 16 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.803170:0:16245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bda6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352e5 expref: 15 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638675.803179:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c73a62bfd00) 00010000:00010000:0.0:1788638675.803182:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788638675.803185:0:16245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5466a00, rc 0) 00000100:00100000:0.0:1788638675.803285:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+15:14468:x1875523174257920:12345-192.168.203.34@tcp:101:lfs.0 Request processed in 599us (1004us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788638675.805772:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 31 00000100:00100000:1.0:1788638675.806741:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638675.806980:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174258176 00000100:00100000:0.0:1788638675.806991:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174258176 00000100:00100000:2.0:1788638675.807137:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 32 00000100:00100000:2.0:1788638675.807149:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+15:14468:x1875523174258176:12345-192.168.203.34@tcp:54:lfs.0 00010000:00010000:2.0:1788638675.807215:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdb4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.807232:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.807244:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.807286:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdb4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.807294:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdb4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.807301:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdb4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.807306:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638675.807310:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdb4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.807318:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdb4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.807329:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c73a62bfd00) 00010000:00010000:2.0:1788638675.807332:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788638675.807336:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdb4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638675.807343:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdb4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638675.807417:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7d05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+15:14468:x1875523174258176:12345-192.168.203.34@tcp:54:lfs.0 Request processed in 269us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638675.807432:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 32 00000100:00100000:0.0:1788638675.808188:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638675.808252:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174258048 00000100:00100000:3.0:1788638675.808259:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174258048 00000100:00100000:3.0:1788638675.808334:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 0 00000100:00100000:3.0:1788638675.808343:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a963600-85ae-4d04-99fd-4389bf419479+15:2365:x1875523174258048:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788638675.808354:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638675.808369:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466a00/0xa0b1f1e3b4b2bda6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352e5 expref: 15 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638675.808382:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c73a62bfd00) 00010000:00010000:3.0:1788638675.808386:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788638675.808423:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a963600-85ae-4d04-99fd-4389bf419479+14:2365:x1875523174258048:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 82us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638675.808439:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 0 00000100:00100000:0.0:1788638675.810460:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638675.810520:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174258432 00000100:00100000:2.0:1788638675.810529:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174258432 00000100:00100000:2.0:1788638675.810590:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 7 00000100:00100000:2.0:1788638675.810614:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a963600-85ae-4d04-99fd-4389bf419479+14:14468:x1875523174258432:12345-192.168.203.34@tcp:35:lfs.0 00000100:00100000:2.0:1788638675.810871:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a963600-85ae-4d04-99fd-4389bf419479+15:14468:x1875523174258432:12345-192.168.203.34@tcp:35:lfs.0 Request processed in 259us (416us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788638675.810879:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 7 00010000:00010000:1.0:1788638676.000882:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788638676.111530:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638676.111628:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174258688 00000100:00100000:2.0:1788638676.111639:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174258688 00000100:00100000:2.0:1788638676.111699:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 33 00000100:00100000:2.0:1788638676.111709:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+15:14499:x1875523174258688:12345-192.168.203.34@tcp:101:cat.0 00010000:00010000:2.0:1788638676.111731:0:16245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638676.111762:0:16245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdbb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14352ec expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.111893:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2bdc2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.111909:0:16245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2bdc2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.111920:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2bdc2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638676.111930:0:16245:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788638676.112085:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdbb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352ec expref: 18 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.112103:0:16245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2bdc2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352ec expref: 17 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.112127:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c73a62bfd00) 00010000:00010000:2.0:1788638676.112130:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788638676.112134:0:16245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7c00, rc 0) 00000100:00100000:2.0:1788638676.112416:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7d06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+17:14499:x1875523174258688:12345-192.168.203.34@tcp:101:cat.0 Request processed in 708us (894us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1788638676.112433:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 33 00000100:00100000:0.0:1788638676.123969:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638676.124123:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174258944 00000100:00100000:3.0:1788638676.124134:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174258944 00000100:00100000:3.0:1788638676.124194:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:3.0:1788638676.124205:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a963600-85ae-4d04-99fd-4389bf419479+17:14499:x1875523174258944:12345-192.168.203.34@tcp:35:cat.0 00000100:00100000:3.0:1788638676.124603:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a963600-85ae-4d04-99fd-4389bf419479+18:14499:x1875523174258944:12345-192.168.203.34@tcp:35:cat.0 Request processed in 398us (641us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1788638676.124611:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 8 00000100:00100000:0.0:1788638676.128619:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638676.128661:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174259072 00000100:00100000:1.0:1788638676.128671:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174259072 00000100:00100000:1.0:1788638676.128734:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 1 00000100:00100000:1.0:1788638676.128745:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a963600-85ae-4d04-99fd-4389bf419479+18:2364:x1875523174259072:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638676.128761:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638676.128809:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2bdc2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352ec expref: 18 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.128829:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c73a62bfd00) 00010000:00010000:1.0:1788638676.128834:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638676.128892:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a963600-85ae-4d04-99fd-4389bf419479+17:2364:x1875523174259072:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 148us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638676.128899:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 1 00000100:00100000:1.0:1788638676.198086:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638676.198311:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174259328 00000100:00100000:3.0:1788638676.198321:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174259328 00000100:00100000:3.0:1788638676.198387:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 34 00000100:00100000:3.0:1788638676.198397:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+17:14505:x1875523174259328:12345-192.168.203.34@tcp:101:dd.0 00010000:00010000:3.0:1788638676.198421:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638676.198452:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2bdd0 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14352f3 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638676.198548:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bdd7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638676.198572:0:14395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2bd75 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352d0 expref: 18 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638676.198580:0:14395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd8a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352d7 expref: 18 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638676.198588:0:14395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bdd7 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638676.198622:0:14395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352d7 expref: 18 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638676.198635:0:14395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd8a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352d7 expref: 18 pid: 16245 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638676.198667:0:14395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14395:1875523183684864:192.168.203.34@tcp:104: 00010000:00010000:3.0:1788638676.199055:0:14395:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2bd75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352d0 expref: 18 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638676.199074:0:14395:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2bd75 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352d0 expref: 18 pid: 14397 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638676.199083:0:14395:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7385378380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14395:1875523183684992:192.168.203.34@tcp:104: 00000100:00100000:3.0:1788638676.199120:0:14395:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73837309c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788638676.209979:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638676.210019:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638676.210077:0:14395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14395:1875523183684864:192.168.203.34@tcp:104: 00000100:00100000:2.0:1788638676.210090:0:14395:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7385378380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14395:1875523183684992:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638676.210115:0:14395:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bdd7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638676.210174:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174259456 00000100:00100000:1.0:1788638676.210181:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174259456 00000100:00100000:0.0:1788638676.210181:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174259584 00000100:00100000:0.0:1788638676.210185:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174259584 00010000:00010000:1.0:1788638676.210221:0:14381:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd8a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352d7 expref: 20 pid: 16245 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638676.210227:0:14382:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2bd75 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352d0 expref: 20 pid: 14397 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638676.210301:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 11 00000100:00100000:1.0:1788638676.210311:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bbb19850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a963600-85ae-4d04-99fd-4389bf419479+20:2366:x1875523174259456:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638676.210325:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638676.210333:0:14381:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd8a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352d7 expref: 20 pid: 16245 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.210377:0:14381:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd8a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352d7 expref: 20 pid: 16245 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.210408:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5466c00/0xa0b1f1e3b4b2bd8a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352d7 expref: 20 pid: 16245 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.210440:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c73a62bfd00) 00010000:00010000:1.0:1788638676.210447:0:14381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bdd7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.210455:0:14381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bdd7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.210462:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638676.210519:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bbb19850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a963600-85ae-4d04-99fd-4389bf419479+19:2366:x1875523174259456:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 209us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638676.210526:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 11 00000100:00100000:1.0:1788638676.210579:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00100000:1.0:1788638676.210586:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a963600-85ae-4d04-99fd-4389bf419479+18:2366:x1875523174259584:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638676.210593:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638676.210599:0:14381:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2bd75 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352d0 expref: 18 pid: 14397 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.210609:0:14381:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2bd75 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352d0 expref: 18 pid: 14397 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.210633:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5467c00/0xa0b1f1e3b4b2bd75 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352d0 expref: 18 pid: 14397 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.210642:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c73a62bfd00) 00010000:00010000:1.0:1788638676.210646:0:14381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bdd7 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.210654:0:14381:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bdd7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.210661:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bdd7 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.210683:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638676.210705:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a963600-85ae-4d04-99fd-4389bf419479+17:2366:x1875523174259584:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 119us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638676.210711:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 12 00010000:00010000:3.0:1788638676.210951:0:14395:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bdd7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638676.210959:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bdd7 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788638676.210988:0:14395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1788638676.211147:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2bdd0 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352f3 expref: 18 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638676.211163:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fd200/0xa0b1f1e3b4b2bdd7 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352f3 expref: 17 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638676.211171:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c73a62bfd00) 00010000:00010000:3.0:1788638676.211173:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788638676.211182:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73813fd200, rc 0) 00000100:00100000:3.0:1788638676.211214:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7d04a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+17:14505:x1875523174259328:12345-192.168.203.34@tcp:101:dd.0 Request processed in 12820us (13136us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1788638676.211222:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 34 00000100:00100000:3.0:1788638676.226307:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638676.226416:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174259840 00000100:00100000:1.0:1788638676.226434:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174259840 00000100:00100000:1.0:1788638676.226495:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 35 00000100:00100000:1.0:1788638676.226506:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a963600-85ae-4d04-99fd-4389bf419479+17:14505:x1875523174259840:12345-192.168.203.34@tcp:36:dd.0 00010000:00010000:1.0:1788638676.226918:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5569200/0xa0b1f1e3b4b2bde5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.226936:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5569200/0xa0b1f1e3b4b2bde5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.226947:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5569200/0xa0b1f1e3b4b2bde5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788638676.227012:0:14396:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788638676.227045:0:14396:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ebaf7db5 reply state 00000000b4e8386c transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5569200/0xa0b1f1e3b4b2bde5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638676.227054:0:14396:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788638676.227142:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a963600-85ae-4d04-99fd-4389bf419479+20:14505:x1875523174259840:12345-192.168.203.34@tcp:36:dd.0 Request processed in 637us (843us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788638676.227149:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 35 00000020:00080000:1.0:1788638676.227153:0:14396:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788638676.228716:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5569200/0xa0b1f1e3b4b2bde5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.228740:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5569200/0xa0b1f1e3b4b2bde5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.228747:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5569200/0xa0b1f1e3b4b2bde5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.228753:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5569200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638676.228757:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5569200/0xa0b1f1e3b4b2bde5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.228765:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5569200/0xa0b1f1e3b4b2bde5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.228812:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c73a62bfd00) 00010000:00010000:2.0:1788638676.228827:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638676.228833:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5569200/0xa0b1f1e3b4b2bde5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.228841:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5569200/0xa0b1f1e3b4b2bde5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638676.233072:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638676.236142:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174259968 00000100:00100000:2.0:1788638676.236157:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174259968 00000100:00100000:2.0:1788638676.236363:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 36 00000100:00100000:2.0:1788638676.236376:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+19:14505:x1875523174259968:12345-192.168.203.34@tcp:101:dd.0 00010000:00010000:2.0:1788638676.236402:0:14397:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638676.236432:0:14397:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdec lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a14352fa expref: -99 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.236494:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdec lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352fa expref: 20 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.236509:0:14397:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdec lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352fa expref: 20 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.236530:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c73a62bfd00) 00010000:00010000:2.0:1788638676.236534:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788638676.236537:0:14397:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7200, rc 0) 00000100:00100000:2.0:1788638676.236609:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+20:14505:x1875523174259968:12345-192.168.203.34@tcp:101:dd.0 Request processed in 236us (3546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638676.236616:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 36 00000100:00100000:3.0:1788638676.270939:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638676.273126:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174260224 00000100:00100000:0.0:1788638676.273142:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174260224 00000100:00100000:0.0:1788638676.273259:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 2 00000100:00100000:0.0:1788638676.273271:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7385378a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a963600-85ae-4d04-99fd-4389bf419479+20:14505:x1875523174260224:12345-192.168.203.34@tcp:103:dd.0 00010000:00010000:0.0:1788638676.273289:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788638676.273314:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdec lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a14352fa expref: 20 pid: 14397 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638676.273335:0:14382:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c73a62bfd00) 00010000:00010000:0.0:1788638676.273341:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788638676.273414:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7385378a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a963600-85ae-4d04-99fd-4389bf419479+19:14505:x1875523174260224:12345-192.168.203.34@tcp:103:dd.0 Request processed in 146us (2484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638676.273432:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 2 00000100:00100000:1.0:1788638676.278853:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638676.278998:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174260352 00000100:00100000:2.0:1788638676.279007:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174260352 00000100:00100000:2.0:1788638676.279079:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 37 00000100:00100000:2.0:1788638676.279089:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a963600-85ae-4d04-99fd-4389bf419479+19:14505:x1875523174260352:12345-192.168.203.34@tcp:58:dd.0 00010000:00010000:2.0:1788638676.279182:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2bdf3 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.279200:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2bdf3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.279210:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2bdf3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788638676.279993:0:14396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788638676.280155:0:14396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788638676.280225:0:14396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788638676.280329:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7d04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a963600-85ae-4d04-99fd-4389bf419479+19:14505:x1875523174260352:12345-192.168.203.34@tcp:58:dd.0 Request processed in 1239us (1484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638676.280338:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 37 00000100:00100000:3.0:1788638676.282630:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638676.284739:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174260480 00000100:00100000:2.0:1788638676.284752:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174260480 00000100:00100000:2.0:1788638676.284846:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 38 00000100:00100000:2.0:1788638676.284857:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73bf61dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+19:14505:x1875523174260480:12345-192.168.203.34@tcp:101:dd.0 00010000:00010000:2.0:1788638676.284877:0:14395:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638676.284897:0:14395:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdfa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435301 expref: -99 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.284950:0:14395:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2bdf3 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.284960:0:14395:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdfa lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435301 expref: 20 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.284998:0:14395:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2bdf3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.285012:0:14395:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdfa lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435301 expref: 20 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.285024:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c73a62bfd00) 00010000:00010000:2.0:1788638676.285027:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788638676.285031:0:14395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdfa lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435301 expref: 20 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.285038:0:14395:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c7399aa7200, rc 0) 00000100:00100000:2.0:1788638676.285106:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73bf61dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+20:14505:x1875523174260480:12345-192.168.203.34@tcp:101:dd.0 Request processed in 251us (2485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638676.285113:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 38 00000040:00080000:3.0:1788638676.704027:0:14429:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788638676.704039:0:14429:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788638676.704079:0:14429:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788638676.704086:0:14429:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788638676.704215:0:14429:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b4665c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14429:1875523183685120:192.168.203.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788638676.704327:0:14429:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c7383730000 going to sleep for 11 seconds 00000100:00100000:2.0:1788638676.710857:0:14429:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b4665c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14429:1875523183685120:192.168.203.34@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788638676.723741:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638676.723974:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174260608 00000100:00100000:1.0:1788638676.724002:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174260608 00000100:00100000:1.0:1788638676.724057:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 0 00000100:00100000:1.0:1788638676.724068:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0a963600-85ae-4d04-99fd-4389bf419479+20:14506:x1875523174260608:12345-192.168.203.34@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1788638676.724208:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0a963600-85ae-4d04-99fd-4389bf419479+20:14506:x1875523174260608:12345-192.168.203.34@tcp:900:lhsmtool_posix.0 Request processed in 141us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638676.724228:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 0 00000100:00100000:3.0:1788638676.727759:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638676.727996:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174260736 00000100:00100000:2.0:1788638676.728006:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174260736 00000100:00100000:2.0:1788638676.728055:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 39 00000100:00100000:2.0:1788638676.728066:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b4665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a963600-85ae-4d04-99fd-4389bf419479+20:14506:x1875523174260736:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788638676.728114:0:14396:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788638676.728234:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b4665c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a963600-85ae-4d04-99fd-4389bf419479+20:14506:x1875523174260736:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 Request processed in 170us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638676.728242:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 39 00000100:00100000:0.0:1788638676.733595:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638676.734332:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174260864 00000100:00100000:2.0:1788638676.734350:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174260864 00000100:00100000:2.0:1788638676.734411:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 40 00000100:00100000:2.0:1788638676.734756:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+20:14506:x1875523174260864:12345-192.168.203.34@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788638676.734854:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2be01 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.734872:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2be01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.734884:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2be01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.734948:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be08 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.734956:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.734962:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.735285:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2be0f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.735295:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2be0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.735302:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2be0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638676.735339:0:14395:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788638676.735343:0:14395:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788638676.735364:0:14395:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2be0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.735374:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2be01 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.735380:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2be01 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.735386:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2be01 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.735391:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa7c00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638676.735395:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2be01 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.735402:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2be01 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.735412:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7393e81800) 00010000:00010000:2.0:1788638676.735414:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638676.736075:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2be01 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.736087:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7c00/0xa0b1f1e3b4b2be01 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.736103:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be08 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.736109:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be08 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.736115:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be08 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.736129:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638676.736133:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be08 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.736139:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be08 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.736148:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9c738a6e9700) 00010000:00010000:2.0:1788638676.736151:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638676.736154:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be08 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.736160:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be08 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.736175:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2be0f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.736180:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2be0f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.736185:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2be0f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.736190:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01ce00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638676.736193:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2be0f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.736199:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2be0f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.736410:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c73a62bfd00) 00010000:00010000:2.0:1788638676.736413:0:14395:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638676.736417:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2be0f lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.736432:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2be0f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638676.736706:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+20:14506:x1875523174260864:12345-192.168.203.34@tcp:34:lhsmtool_posix.0 Request processed in 2283us (3227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638676.736716:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 40 00000100:00100000:3.0:1788638676.742367:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638676.742465:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174261120 00000100:00100000:2.0:1788638676.742475:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174261120 00000100:00100000:2.0:1788638676.742535:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 41 00000100:00100000:2.0:1788638676.742546:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a963600-85ae-4d04-99fd-4389bf419479+20:14506:x1875523174261120:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788638676.742566:0:14396:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788638676.742588:0:14396:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2be16 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435308 expref: -99 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.742682:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2be1d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.742698:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2be1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.742711:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2be1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788638676.742721:0:14396:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788638676.742873:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2be1d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.742882:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2be1d lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.742888:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2be1d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.742894:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638676.742898:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2be1d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.742904:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2be1d lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.742915:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c73a62bfd00) 00010000:00010000:2.0:1788638676.742918:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788638676.742922:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2be1d lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.742928:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d800/0xa0b1f1e3b4b2be1d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.742966:0:14396:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2be16 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435308 expref: 22 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.742975:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9c7393e81800) 00010000:00010000:2.0:1788638676.742977:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788638676.742981:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2be16 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435308 expref: 22 pid: 14396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.743015:0:14396:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73bc01da00, rc 0) 00000100:00100000:2.0:1788638676.743078:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a963600-85ae-4d04-99fd-4389bf419479+21:14506:x1875523174261120:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 533us (720us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1788638676.743086:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 41 00000100:00100000:3.0:1788638676.747108:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638676.752591:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174261248 00000100:00100000:1.0:1788638676.752609:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174261248 00000100:00100000:1.0:1788638676.752686:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 42 00000100:00100000:1.0:1788638676.752697:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+21:14506:x1875523174261248:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788638676.752732:0:14397:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788638676.752866:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+21:14506:x1875523174261248:12345-192.168.203.34@tcp:53:lhsmtool_posix.0 Request processed in 170us (5766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638676.752874:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 42 00000100:00100000:0.0:1788638676.756142:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638676.756248:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174261504 00000100:00100000:1.0:1788638676.756272:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174261504 00000100:00100000:1.0:1788638676.756332:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 43 00000100:00100000:1.0:1788638676.756351:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+21:14506:x1875523174261504:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788638676.756372:0:16245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638676.756398:0:16245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568200/0xa0b1f1e3b4b2be2b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143530f expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788638676.757163:0:16245:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:1.0:1788638676.757171:0:16245:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:1.0:1788638676.757215:0:16245:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:1.0:1788638676.757492:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568c00/0xa0b1f1e3b4b2be32 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.757508:0:16245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568c00/0xa0b1f1e3b4b2be32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.757520:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568c00/0xa0b1f1e3b4b2be32 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.757579:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568200/0xa0b1f1e3b4b2be2b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143530f expref: 24 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.757600:0:16245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568c00/0xa0b1f1e3b4b2be32 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143530f expref: 23 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.757609:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7393fc6900) 00010000:00010000:1.0:1788638676.757612:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788638676.757616:0:16245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5568c00, rc 0) 00000100:00100000:1.0:1788638676.757682:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+23:14506:x1875523174261504:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 1341us (1550us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1788638676.757698:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 43 00000100:00100000:3.0:1788638676.768094:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638676.769732:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174261760 00000100:00100000:1.0:1788638676.769747:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174261760 00000100:00100000:1.0:1788638676.769826:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 44 00000100:00100000:1.0:1788638676.769837:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+23:14506:x1875523174261760:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788638676.769895:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638676.769920:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568c00/0xa0b1f1e3b4b2be32 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143530f expref: 23 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.769939:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7393fc6900) 00010000:00010000:1.0:1788638676.769949:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788638676.769972:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568200/0xa0b1f1e3b4b2be40 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.769987:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568200/0xa0b1f1e3b4b2be40 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.769998:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568200/0xa0b1f1e3b4b2be40 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.770013:0:14397:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5569400/0xa0b1f1e3b4b2be47 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x44bbd96c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.770020:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5569400/0xa0b1f1e3b4b2be47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x44bbd96c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.770027:0:14397:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5569400/0xa0b1f1e3b4b2be47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x44bbd96c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.770238:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568200/0xa0b1f1e3b4b2be40 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.770246:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568200/0xa0b1f1e3b4b2be40 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.770253:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568200/0xa0b1f1e3b4b2be40 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.770258:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5568200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638676.770262:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568200/0xa0b1f1e3b4b2be40 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.770270:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568200/0xa0b1f1e3b4b2be40 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.770279:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9c73a62bf100) 00010000:00010000:1.0:1788638676.770282:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638676.770286:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568200/0xa0b1f1e3b4b2be40 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.770292:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568200/0xa0b1f1e3b4b2be40 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.770301:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5569400/0xa0b1f1e3b4b2be47 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x44bbd96c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.770308:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5569400/0xa0b1f1e3b4b2be47 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x44bbd96c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.770314:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5569400/0xa0b1f1e3b4b2be47 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x44bbd96c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.770325:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5569400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638676.770329:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5569400/0xa0b1f1e3b4b2be47 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x44bbd96c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.770335:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5569400/0xa0b1f1e3b4b2be47 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x44bbd96c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.770343:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x44bbd96c (ffff9c7393fc6800) 00010000:00010000:1.0:1788638676.770346:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638676.770349:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5569400/0xa0b1f1e3b4b2be47 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x44bbd96c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.770355:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5569400/0xa0b1f1e3b4b2be47 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x44bbd96c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14397 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638676.770449:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0a963600-85ae-4d04-99fd-4389bf419479+22:14506:x1875523174261760:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 Request processed in 613us (2363us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788638676.771984:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 44 00000100:00100000:3.0:1788638676.774945:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638676.775041:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174261888 00000100:00100000:1.0:1788638676.775050:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174261888 00000100:00100000:1.0:1788638676.775108:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 45 00000100:00100000:1.0:1788638676.775119:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+22:14506:x1875523174261888:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788638676.775141:0:16245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638676.775163:0:16245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2be4e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435316 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.775196:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568400/0xa0b1f1e3b4b2be55 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.775226:0:16245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568400/0xa0b1f1e3b4b2be55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.775250:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568400/0xa0b1f1e3b4b2be55 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.775347:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2be4e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435316 expref: 24 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.775368:0:16245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568400/0xa0b1f1e3b4b2be55 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435316 expref: 23 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.775377:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7393fc6300) 00010000:00010000:1.0:1788638676.775684:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788638676.775688:0:16245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5568400, rc 0) 00000100:00100000:1.0:1788638676.775751:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+23:14506:x1875523174261888:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 633us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638676.775759:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 45 00000100:00100000:0.0:1788638676.786904:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638676.787085:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174262144 00000100:00100000:2.0:1788638676.787095:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174262144 00000100:00100000:2.0:1788638676.787146:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 46 00000100:00100000:2.0:1788638676.787156:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+23:14506:x1875523174262144:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788638676.787229:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2be5c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.787259:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2be5c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.787271:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2be5c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788638676.787690:0:14395:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788638676.787700:0:14395:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 439858916548ns, next at 440858914323ns, rc = 0 00000004:00010000:2.0:1788638676.787809:0:14395:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006a674606 reply state 00000000e7cec405 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2be5c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638676.787819:0:14395:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788638676.787909:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+25:14506:x1875523174262144:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 Request processed in 754us (1013us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788638676.787917:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 46 00010000:00010000:2.0:1788638676.789751:0:3278:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2be5c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.789777:0:3278:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2be5c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.789857:0:3278:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2be5c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.789863:0:3278:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01da00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638676.789867:0:3278:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2be5c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.789875:0:3278:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2be5c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.789889:0:3278:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7393fc6300) 00010000:00010000:2.0:1788638676.789892:0:3278:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788638676.789897:0:3278:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2be5c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.789902:0:3278:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01da00/0xa0b1f1e3b4b2be5c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638676.791013:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638676.791094:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174262272 00000100:00100000:1.0:1788638676.791102:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174262272 00000100:00100000:1.0:1788638676.791149:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 47 00000100:00100000:1.0:1788638676.791158:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+24:14506:x1875523174262272:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788638676.791179:0:16245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638676.791197:0:16245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2be63 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143531d expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.791261:0:16245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2be63 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143531d expref: 25 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.791286:0:16245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2be63 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143531d expref: 25 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.791306:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7393fc6300) 00010000:00010000:1.0:1788638676.791308:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788638676.791311:0:16245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5568600, rc 0) 00000100:00100000:1.0:1788638676.791368:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+25:14506:x1875523174262272:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 211us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638676.791375:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 47 00000100:00100000:3.0:1788638676.797006:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638676.797083:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174262400 00000100:00100000:1.0:1788638676.797092:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174262400 00000100:00100000:1.0:1788638676.797161:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00100000:1.0:1788638676.797172:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a963600-85ae-4d04-99fd-4389bf419479+5:2367:x1875523174262400:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788638676.797429:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788638676.797773:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a963600-85ae-4d04-99fd-4389bf419479+6:2367:x1875523174262400:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 Request processed in 602us (774us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788638676.797811:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 12 00000100:00100000:3.0:1788638676.809762:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638676.811895:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174262656 00000100:00100000:0.0:1788638676.811908:0:14399:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174262656 00000100:00100000:0.0:1788638676.812021:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:0.0:1788638676.812032:0:14399:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a963600-85ae-4d04-99fd-4389bf419479+25:14506:x1875523174262656:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788638676.812273:0:14399:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0a963600-85ae-4d04-99fd-4389bf419479+26:14506:x1875523174262656:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 Request processed in 243us (2518us total) trans 8589934614 rc 0/0 00000100:00100000:0.0:1788638676.812282:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 9 00000100:00100000:0.0:1788638676.818607:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638676.820531:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174262912 00000100:00100000:2.0:1788638676.820547:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174262912 00000100:00100000:2.0:1788638676.820627:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 48 00000100:00100000:2.0:1788638676.820637:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+26:14506:x1875523174262912:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788638676.820753:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+26:14506:x1875523174262912:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 Request processed in 117us (2155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638676.820762:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 48 00000100:00100000:3.0:1788638676.831313:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638676.832636:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174263040 00000100:00100000:1.0:1788638676.832649:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174263040 00000100:00100000:1.0:1788638676.832713:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 49 00000100:00100000:1.0:1788638676.832724:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+26:14506:x1875523174263040:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788638676.832745:0:16245:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638676.832768:0:16245:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5569400/0xa0b1f1e3b4b2be6a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435324 expref: -99 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.832897:0:16245:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568200/0xa0b1f1e3b4b2be71 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.832919:0:16245:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568200/0xa0b1f1e3b4b2be71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.832932:0:16245:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568200/0xa0b1f1e3b4b2be71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788638676.832967:0:16245:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788638676.832986:0:16245:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568200/0xa0b1f1e3b4b2be71 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16245 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.833014:0:16245:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5569400/0xa0b1f1e3b4b2be6a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435324 expref: 28 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.833033:0:16245:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568200/0xa0b1f1e3b4b2be71 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435324 expref: 27 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.833043:0:16245:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7393fc6300) 00010000:00010000:1.0:1788638676.833046:0:16245:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788638676.833050:0:16245:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5568200, rc 0) 00000100:00100000:1.0:1788638676.833108:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+27:14506:x1875523174263040:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 386us (1803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638676.833116:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 49 00000100:00100000:3.0:1788638676.839356:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638676.842676:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174263168 00000100:00100000:1.0:1788638676.842693:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174263168 00000100:00100000:1.0:1788638676.842762:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:1.0:1788638676.842772:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a963600-85ae-4d04-99fd-4389bf419479+6:2365:x1875523174263168:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788638676.842815:0:15078:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788638676.842850:0:15078:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2be78 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a143532b expref: -99 pid: 15078 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788638676.842879:0:15078:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c75d5, blocks: 0x1 00010000:00010000:1.0:1788638676.842897:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=439s v=(0 0) 00010000:00010000:1.0:1788638676.842902:0:15078:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638676.842911:0:15078:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2be78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143532b expref: 7 pid: 15078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.842930:0:15078:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2be78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143532b expref: 7 pid: 15078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.842943:0:15078:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73b5568c00, rc 0) 00000100:00100000:1.0:1788638676.843009:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a963600-85ae-4d04-99fd-4389bf419479+7:2365:x1875523174263168:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 238us (3663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638676.843016:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:0.0:1788638676.845942:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638676.846019:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174263424 00000100:00100000:2.0:1788638676.846029:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174263424 00000100:00100000:2.0:1788638676.846086:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 50 00000100:00100000:2.0:1788638676.846096:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+27:14506:x1875523174263424:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788638676.846205:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+27:14506:x1875523174263424:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 Request processed in 110us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638676.846213:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 50 00000100:00100000:3.0:1788638676.853184:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638676.855296:0:16245:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174263552 00000100:00100000:1.0:1788638676.855310:0:16245:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174263552 00000100:00100000:1.0:1788638676.855388:0:16245:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 51 00000100:00100000:1.0:1788638676.855397:0:16245:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+27:14506:x1875523174263552:12345-192.168.203.34@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788638676.944427:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1788638676.944473:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788638676.944627:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183685248:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788638676.944693:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638676.944771:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183685248 00000100:00100000:2.0:1788638676.944778:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183685248 00000100:00100000:2.0:1788638676.944848:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788638676.944857:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183685248:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788638676.945001:0:15077:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788638676.945004:0:15077:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1788638676.945006:0:15077:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788638676.945009:0:15077:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788638677 -> 1788638677 00002000:00010000:2.0:1788638676.945011:0:15077:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788638676.945051:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3293:x1875523183685248:12345-0@lo:2:osp-syn-0-0.0 Request processed in 195us (357us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1788638676.945058:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788638676.945081:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788638676.945110:0:3293:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9c73837a5f80/2, rc 0, transno 8589934595 00000100:00100000:2.0:1788638676.945115:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183685248:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788638676.945286:0:16245:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0a963600-85ae-4d04-99fd-4389bf419479+14:14506:x1875523174263552:12345-192.168.203.34@tcp:44:lhsmtool_posix.0 Request processed in 89888us (92110us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638676.945295:0:16245:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 51 00000100:00100000:3.0:1788638676.956939:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638676.957216:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174263680 00000100:00100000:1.0:1788638676.957226:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174263680 00000100:00100000:1.0:1788638676.957326:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 15 00000100:00100000:1.0:1788638676.957336:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a963600-85ae-4d04-99fd-4389bf419479+7:2364:x1875523174263680:12345-192.168.203.34@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788638676.957461:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a963600-85ae-4d04-99fd-4389bf419479+7:2364:x1875523174263680:12345-192.168.203.34@tcp:16:lhsmtool_posix.0 Request processed in 126us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638676.957487:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 15 00000100:00100000:2.0:1788638676.966178:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638676.966503:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174263936 00000100:00100000:3.0:1788638676.966523:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174263936 00000100:00100000:3.0:1788638676.966582:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 52 00000100:00100000:3.0:1788638676.966594:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+14:14506:x1875523174263936:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788638676.966645:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638676.966671:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568200/0xa0b1f1e3b4b2be71 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435324 expref: 14 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638676.966691:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7393fc6300) 00010000:00010000:3.0:1788638676.966696:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788638676.966725:0:14395:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2be7f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638676.966739:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2be7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638676.966749:0:14395:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2be7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788638676.966969:0:14395:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a429522b reply state 0000000040c62283 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2be7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638676.966978:0:14395:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788638676.967067:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+15:14506:x1875523174263936:12345-192.168.203.34@tcp:36:lhsmtool_posix.0 Request processed in 475us (898us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788638676.967075:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 52 00000100:00100000:2.0:1788638676.970181:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638676.970251:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174264064 00000100:00100000:3.0:1788638676.970262:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174264064 00000100:00100000:3.0:1788638676.970315:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 16 00000100:00100000:3.0:1788638676.970338:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a963600-85ae-4d04-99fd-4389bf419479+7:14506:x1875523174264064:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788638676.970356:0:15079:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788638676.970377:0:15079:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acb3518d/0xa0b1f1e3b4b2be86 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x500f9f54a1435332 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.970382:0:3277:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2be7f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.970392:0:3277:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2be7f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.970399:0:3277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2be7f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.970405:0:3277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fc200 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:1.0:1788638676.970409:0:3277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2be7f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638676.970410:0:15079:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2be78 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143532b expref: 8 pid: 15078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.970427:0:3277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2be7f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638676.970429:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1788638676.970433:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788638676.970438:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acb3518d/0xa0b1f1e3b4b2be86 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435332 expref: 8 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.970442:0:3277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7393fc6300) 00010000:00010000:1.0:1788638676.970444:0:3277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788638676.970449:0:3277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2be7f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.970455:0:3277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73813fc200/0xa0b1f1e3b4b2be7f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14395 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638676.970472:0:15079:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2be78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143532b expref: 8 pid: 15078 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638676.970485:0:15079:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2be78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143532b expref: 8 pid: 15078 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638676.970501:0:15079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387dbea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15079:1875523183685376:192.168.203.34@tcp:104: 00000100:00100000:3.0:1788638676.970596:0:15079:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c739870b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788638676.972824:0:15079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387dbea00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15079:1875523183685376:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638676.972858:0:15079:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000acb3518d/0xa0b1f1e3b4b2be86 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435332 expref: 8 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638676.972878:0:15079:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9c73813fd800, rc 0) 00000100:00100000:2.0:1788638676.972927:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a963600-85ae-4d04-99fd-4389bf419479+8:14506:x1875523174264064:12345-192.168.203.34@tcp:101:lhsmtool_posix.0 Request processed in 2590us (2755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638676.972935:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 16 00000100:00100000:0.0:1788638676.985882:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638676.985977:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174264192 00000100:00100000:1.0:1788638676.986000:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174264192 00010000:00010000:1.0:1788638676.986037:0:14381:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2be78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143532b expref: 8 pid: 15078 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638676.986078:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:1.0:1788638676.986106:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a963600-85ae-4d04-99fd-4389bf419479+8:2364:x1875523174264192:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638676.986122:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638676.986142:0:14381:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2be78 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143532b expref: 8 pid: 15078 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.986156:0:14381:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2be78 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143532b expref: 8 pid: 15078 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.986180:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023ead9a0/0xa0b1f1e3b4b2be78 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143532b expref: 8 pid: 15078 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.986196:0:14381:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638676.986210:0:14381:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638676.986218:0:14381:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000acb3518d/0xa0b1f1e3b4b2be86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435332 expref: 7 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.986228:0:14381:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acb3518d/0xa0b1f1e3b4b2be86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435332 expref: 7 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638676.986262:0:14381:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000acb3518d/0xa0b1f1e3b4b2be86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435332 expref: 7 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638676.986276:0:14381:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73b7d05880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14381:1875523183685504:192.168.203.34@tcp:105: 00000100:00100000:1.0:1788638676.986357:0:14381:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73ad4dd180 going to sleep for 11 seconds 00000100:00100000:1.0:1788638676.990322:0:14381:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73b7d05880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14381:1875523183685504:192.168.203.34@tcp:105: 00010000:00010000:1.0:1788638676.990375:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638676.990447:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a963600-85ae-4d04-99fd-4389bf419479+7:2364:x1875523174264192:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 4343us (4580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638676.990458:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 13 00000100:00100000:3.0:1788638676.993968:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638676.994065:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174264320 00000100:00100000:1.0:1788638676.994074:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174264320 00000100:00100000:1.0:1788638676.994141:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 17 00000100:00100000:1.0:1788638676.994152:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a963600-85ae-4d04-99fd-4389bf419479+7:2365:x1875523174264320:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788638676.994428:0:15078:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788638676.994432:0:15078:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788638676 00002000:00010000:1.0:1788638676.994434:0:15078:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788638675 00002000:00010000:1.0:1788638676.994436:0:15078:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788638677 -> 1788638676 00002000:00010000:1.0:1788638676.994438:0:15078:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788638676.994502:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0a963600-85ae-4d04-99fd-4389bf419479+8:2365:x1875523174264320:12345-192.168.203.34@tcp:2:lhsmtool_posix.0 Request processed in 352us (548us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1788638676.994510:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 17 00000100:00100000:0.0:1788638677.005601:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638677.005799:0:15079:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174264448 00000100:00100000:2.0:1788638677.005809:0:15079:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174264448 00000100:00100000:2.0:1788638677.006071:0:15079:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 18 00000100:00100000:2.0:1788638677.006083:0:15079:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a963600-85ae-4d04-99fd-4389bf419479+8:2365:x1875523174264448:12345-192.168.203.34@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788638677.006127:0:15079:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ec8f1c19/0xa0b1f1e3b4b2be8d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.006148:0:15079:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000acb3518d/0xa0b1f1e3b4b2be86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435332 expref: 8 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.006157:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788638677.006161:0:15079:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788638677.006165:0:15079:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec8f1c19/0xa0b1f1e3b4b2be8d lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.006203:0:15079:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000acb3518d/0xa0b1f1e3b4b2be86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435332 expref: 8 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.006246:0:15079:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000acb3518d/0xa0b1f1e3b4b2be86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435332 expref: 8 pid: 15079 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638677.006262:0:15079:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15079:1875523183685632:192.168.203.34@tcp:104: 00000100:00100000:2.0:1788638677.006348:0:15079:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bb5b0b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788638677.009312:0:15079:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15079:1875523183685632:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638677.009339:0:15079:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ec8f1c19/0xa0b1f1e3b4b2be8d lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638677.011913:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638677.012385:0:14382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174264576 00000100:00100000:3.0:1788638677.012395:0:14382:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174264576 00010000:00010000:3.0:1788638677.012441:0:14382:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000acb3518d/0xa0b1f1e3b4b2be86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435332 expref: 9 pid: 15079 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638677.012501:0:14382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 14 00000100:00100000:3.0:1788638677.012511:0:14382:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7398c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a963600-85ae-4d04-99fd-4389bf419479+9:2365:x1875523174264576:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788638677.012524:0:14382:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788638677.012545:0:14382:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000acb3518d/0xa0b1f1e3b4b2be86 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435332 expref: 9 pid: 15079 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.012558:0:14382:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000acb3518d/0xa0b1f1e3b4b2be86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435332 expref: 9 pid: 15079 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.012592:0:14382:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acb3518d/0xa0b1f1e3b4b2be86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435332 expref: 9 pid: 15079 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.012610:0:14382:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788638677.012614:0:14382:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788638677.012620:0:14382:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec8f1c19/0xa0b1f1e3b4b2be8d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.012630:0:14382:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec8f1c19/0xa0b1f1e3b4b2be8d lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.012668:0:14382:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788638677.013705:0:15079:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ec8f1c19/0xa0b1f1e3b4b2be8d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638677.013720:0:15079:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec8f1c19/0xa0b1f1e3b4b2be8d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638677.013753:0:15079:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000ec8f1c19/0xa0b1f1e3b4b2be8d lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638677.013763:0:15079:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec8f1c19/0xa0b1f1e3b4b2be8d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638677.013817:0:15079:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec8f1c19/0xa0b1f1e3b4b2be8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638677.013824:0:15079:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d800 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638677.013829:0:15079:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec8f1c19/0xa0b1f1e3b4b2be8d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638677.013838:0:15079:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec8f1c19/0xa0b1f1e3b4b2be8d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638677.013855:0:15079:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec8f1c19/0xa0b1f1e3b4b2be8d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638677.013863:0:15079:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec8f1c19/0xa0b1f1e3b4b2be8d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15079 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638677.013965:0:15079:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0a963600-85ae-4d04-99fd-4389bf419479+8:2365:x1875523174264448:12345-192.168.203.34@tcp:1:lhsmtool_posix.0 Request processed in 7881us (8370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638677.013976:0:15079:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 18 00000100:00100000:3.0:1788638677.014281:0:14382:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7398c2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0a963600-85ae-4d04-99fd-4389bf419479+7:2365:x1875523174264576:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 1769us (2375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638677.014291:0:14382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 14 00010000:00010000:2.0:1788638677.024133:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638677.027534:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638677.027639:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174264832 00000100:00100000:2.0:1788638677.027649:0:14396:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174264832 00000100:00100000:2.0:1788638677.027732:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 53 00000100:00100000:2.0:1788638677.027743:0:14396:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a963600-85ae-4d04-99fd-4389bf419479+14:14506:x1875523174264832:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788638677.027862:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2be94 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.027891:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2be94 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.027904:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2be94 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.028146:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be9b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.028168:0:14396:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2be63 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a143531d expref: 15 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.028177:0:14396:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be9b lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.028211:0:14396:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2be63 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143531d expref: 15 pid: 16245 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.028225:0:14396:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2be63 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143531d expref: 15 pid: 16245 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638677.028239:0:14396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14396:1875523183685760:192.168.203.34@tcp:104: 00000100:00100000:2.0:1788638677.028312:0:14396:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c73bb5b0b40 going to sleep for 11 seconds 00000100:00080000:0.0:1788638677.028635:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788638677.031987:0:14396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14396:1875523183685760:192.168.203.34@tcp:104: 00010000:00010000:2.0:1788638677.032017:0:14396:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be9b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638677.035219:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638677.035324:0:14381:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174264960 00000100:00100000:1.0:1788638677.035334:0:14381:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174264960 00010000:00010000:1.0:1788638677.035376:0:14381:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2be63 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143531d expref: 16 pid: 16245 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638677.035433:0:14381:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 15 00000100:00100000:1.0:1788638677.035443:0:14381:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a963600-85ae-4d04-99fd-4389bf419479+16:2364:x1875523174264960:12345-192.168.203.34@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788638677.035456:0:14381:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788638677.035464:0:14381:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2be63 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143531d expref: 16 pid: 16245 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638677.035493:0:14381:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2be63 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143531d expref: 16 pid: 16245 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638677.035514:0:14381:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73b5568600/0xa0b1f1e3b4b2be63 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.34@tcp remote: 0x500f9f54a143531d expref: 16 pid: 16245 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638677.035530:0:14381:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7393fc6300) 00010000:00010000:1.0:1788638677.035535:0:14381:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be9b lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638677.035545:0:14381:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be9b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638677.035553:0:14381:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be9b lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638677.035584:0:14381:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788638677.035885:0:14381:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c29500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0a963600-85ae-4d04-99fd-4389bf419479+15:2364:x1875523174264960:12345-192.168.203.34@tcp:103:ldlm_bl.0 Request processed in 443us (674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638677.035893:0:14381:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 15 00010000:00010000:3.0:1788638677.036366:0:14396:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be9b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.036437:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be9b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788638677.037528:0:14396:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1788638677.038033:0:14396:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1788638677.038084:0:14396:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1788638677.038174:0:14396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387dbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14396:1875523183685888:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788638677.038260:0:14396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638677.038474:0:14396:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c739870b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788638677.039479:0:14400:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183685888 00000100:00100000:0.0:1788638677.039489:0:14400:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183685888 00000100:00100000:0.0:1788638677.039580:0:14400:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788638677.039596:0:14400:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14396:x1875523183685888:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788638677.039880:0:14400:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14396:x1875523183685888:12345-0@lo:1000:mdt00_001.0 Request processed in 285us (1619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638677.039889:0:14400:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788638677.039970:0:14396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387dbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14396:1875523183685888:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1788638677.040671:0:14396:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1788638677.040761:0:14396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387dbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14396:1875523183686016:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788638677.040836:0:14396:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788638677.042032:0:14396:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c739870bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788638677.042066:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183686016 00000100:00100000:1.0:1788638677.042073:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183686016 00000100:00100000:1.0:1788638677.042113:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788638677.042122:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:14396:x1875523183686016:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788638677.042528:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:14396:x1875523183686016:12345-0@lo:1000:mdt00_001.0 Request processed in 406us (1691us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788638677.042537:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788638677.042940:0:14396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387dbc380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14396:1875523183686016:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1788638677.042979:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be9b lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.042989:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be9b lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.042997:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be9b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.043003:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c800 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638677.043007:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be9b lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.043026:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be9b lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.043041:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7393fc6300) 00010000:00010000:3.0:1788638677.043044:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788638677.043049:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be9b lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.043055:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01c800/0xa0b1f1e3b4b2be9b lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.043086:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2bdf3 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.043092:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2bdf3 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.043098:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2bdf3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.043103:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c7399aa6600 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:3.0:1788638677.043106:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2bdf3 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.043112:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2bdf3 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.043119:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c73a62bfd00) 00010000:00010000:3.0:1788638677.043122:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788638677.043128:0:14396:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdfa lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435301 expref: 18 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.043150:0:14396:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdfa lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435301 expref: 18 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.043160:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdfa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435301 expref: 18 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.043213:0:14396:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa7200/0xa0b1f1e3b4b2bdfa lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.34@tcp remote: 0x500f9f54a1435301 expref: 18 pid: 14395 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638677.043226:0:14396:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7387dbdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14396:1875523183686144:192.168.203.34@tcp:105: 00000100:00100000:3.0:1788638677.044142:0:14396:0:(client.c:2716:ptlrpc_set_wait()) set ffff9c739870b000 going to sleep for 11 seconds 00000100:00100000:0.0:1788638677.053189:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638677.053339:0:14396:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7387dbdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14396:1875523183686144:192.168.203.34@tcp:105: 00010000:00010000:2.0:1788638677.053368:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2bdf3 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.053380:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c7399aa6600/0xa0b1f1e3b4b2bdf3 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.053415:0:14396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d400/0xa0b1f1e3b4b2bea2 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.053454:0:14396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d400/0xa0b1f1e3b4b2bea2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.053465:0:14396:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d400/0xa0b1f1e3b4b2bea2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.053476:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d400/0xa0b1f1e3b4b2bea2 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.053483:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d400/0xa0b1f1e3b4b2bea2 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.053489:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d400/0xa0b1f1e3b4b2bea2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.053494:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01d400 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638677.053498:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d400/0xa0b1f1e3b4b2bea2 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.053505:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d400/0xa0b1f1e3b4b2bea2 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.053515:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c73a62bfd00) 00010000:00010000:2.0:1788638677.053518:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788638677.053521:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d400/0xa0b1f1e3b4b2bea2 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.053526:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01d400/0xa0b1f1e3b4b2bea2 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.053535:0:14396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2be94 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.053546:0:14396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2be94 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.053553:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2be94 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.053557:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01ce00 already unused, calling callback (ffffffffc20c14f0) 00010000:00010000:2.0:1788638677.053560:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2be94 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.053574:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2be94 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.053584:0:14396:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9c73a62bfd00) 00010000:00010000:2.0:1788638677.053586:0:14396:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788638677.053589:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2be94 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.053595:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2be94 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14396 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638677.053847:0:14396:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0a963600-85ae-4d04-99fd-4389bf419479+18:14506:x1875523174264832:12345-192.168.203.34@tcp:57:lhsmtool_posix.0 Request processed in 26105us (26321us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788638677.053857:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 53 00000020:00080000:2.0:1788638677.053862:0:14396:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788638677.054395:0:14429:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788638677.054400:0:14429:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788638677.054438:0:14429:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788638677.054444:0:14429:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788638677.055139:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174265088 00000100:00100000:3.0:1788638677.055147:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174265088 00000100:00100000:2.0:1788638677.055250:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:2.0:1788638677.055260:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d46450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a963600-85ae-4d04-99fd-4389bf419479+18:14505:x1875523174265088:12345-192.168.203.34@tcp:49:dd.0 00000100:00100000:2.0:1788638677.055399:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d46450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a963600-85ae-4d04-99fd-4389bf419479+18:14505:x1875523174265088:12345-192.168.203.34@tcp:49:dd.0 Request processed in 139us (2219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638677.055428:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 10 00000100:00100000:0.0:1788638677.059096:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638677.059201:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174265344 00000100:00100000:2.0:1788638677.059212:0:14398:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174265344 00000100:00100000:2.0:1788638677.059269:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 11 00000100:00100000:2.0:1788638677.059280:0:14398:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a963600-85ae-4d04-99fd-4389bf419479+18:14506:x1875523174265344:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788638677.060524:0:14398:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788638677.060960:0:14398:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788638677.061012:0:14398:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2bea9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.061029:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2bea9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.061040:0:14398:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2bea9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.061049:0:14398:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2bea9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.061056:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2bea9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.061062:0:14398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2bea9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.061144:0:14398:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788638677.061244:0:14398:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0a963600-85ae-4d04-99fd-4389bf419479+20:14506:x1875523174265344:12345-192.168.203.34@tcp:35:lhsmtool_posix.0 Request processed in 1963us (2153us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788638677.061254:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 11 00000020:00080000:2.0:1788638677.061266:0:14398:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788638677.064808:0:15767:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788638677.064825:0:15767:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2bea9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.064838:0:15767:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01ce00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638677.064843:0:15767:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2bea9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.064854:0:15767:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2bea9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.064871:0:15767:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9c7393fc6300) 00010000:00010000:3.0:1788638677.065361:0:15767:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788638677.065369:0:15767:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2bea9 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.065398:0:15767:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9c73bc01ce00/0xa0b1f1e3b4b2bea9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14398 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.065529:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638677.065532:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788638677.065533:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788638677.263271:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638677.263527:0:15082:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174265600 00000100:00100000:0.0:1788638677.263537:0:15082:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174265600 00000100:00100000:0.0:1788638677.263607:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 0 00000100:00100000:0.0:1788638677.263619:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0a963600-85ae-4d04-99fd-4389bf419479+7:2367:x1875523174265600:12345-192.168.203.34@tcp:4:dd.0 00002000:00010000:0.0:1788638677.263665:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9c75d4, atime: 0x6a9c75d3, ctime: 0x6a9c75d4, blocks: 0x1 00010000:00010000:0.0:1788638677.263674:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2beb0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638677.263690:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1788638677.263695:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638677.263702:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2beb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638677.263716:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2beb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638677.270535:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638677.270592:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638677.270682:0:15083:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1788638677.270691:0:15083:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788638677.271105:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174265472 00000100:00100000:1.0:1788638677.271114:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174265472 00000100:00100000:1.0:1788638677.271161:0:15083:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788638677.271166:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174265728 00000100:00100000:1.0:1788638677.271169:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174265728 00000100:00100000:2.0:1788638677.271597:0:16627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 1 00000100:00100000:2.0:1788638677.271607:0:16627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0a963600-85ae-4d04-99fd-4389bf419479+10:2366:x1875523174265472:12345-192.168.203.34@tcp:4:dd.0 00010000:00010000:2.0:1788638677.271639:0:16627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2beb7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.271655:0:16627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788638677.271660:0:16627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788638677.271666:0:16627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2beb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.271679:0:16627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2beb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788638677.408858:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:2.0:1788638677.408879:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:0.0:1788638677.408882:0:15082:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00000001:00080000:2.0:1788638677.408888:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:0.0:1788638677.408899:0:15082:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788638676 -> 1788638677 00002000:00010000:0.0:1788638677.408902:0:15082:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:0.0:1788638677.408917:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2beb0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638677.408931:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2beb0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638677.408941:0:15082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2beb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638677.408947:0:15082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466400 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:0.0:1788638677.408952:0:15082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2beb0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.408956:0:16627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2beb7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.408965:0:16627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2beb7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.408972:0:16627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2beb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638677.408974:0:15082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2beb0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.408979:0:16627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01c200 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638677.408982:0:16627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2beb7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638677.408994:0:15082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2beb0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.408998:0:16627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2beb7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638677.409002:0:15082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2beb0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.409008:0:16627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2beb7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.409014:0:16627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6129504/0xa0b1f1e3b4b2beb7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638677.409308:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0a963600-85ae-4d04-99fd-4389bf419479+7:2367:x1875523174265600:12345-192.168.203.34@tcp:4:dd.0 Request processed in 145588us (145943us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788638677.409318:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 0 00000100:00100000:0.0:1788638677.409351:0:15082:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 2 00000100:00100000:0.0:1788638677.409362:0:15082:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0a963600-85ae-4d04-99fd-4389bf419479+6:2364:x1875523174265728:12345-192.168.203.34@tcp:4:dd.0 00002000:00010000:0.0:1788638677.409400:0:15082:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 2097152, mtime: 0x6a9c75d5, atime: 0x6a9c75d3, ctime: 0x0, blocks: 0x1007 00010000:00010000:0.0:1788638677.409407:0:15082:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2bebe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638677.409427:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1788638677.409432:0:15082:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638677.409438:0:15082:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2bebe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638677.409453:0:15082:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2bebe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638677.412715:0:16627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7d05880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0a963600-85ae-4d04-99fd-4389bf419479+6:2366:x1875523174265472:12345-192.168.203.34@tcp:4:dd.0 Request processed in 141096us (142178us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788638677.412731:0:16627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 1 00002000:00010000:1.0:1788638677.527285:0:15082:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:1.0:1788638677.527298:0:15082:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:1.0:1788638677.527317:0:15082:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2bebe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638677.527334:0:15082:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2bebe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638677.527346:0:15082:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2bebe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638677.527356:0:15082:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5467a00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:1.0:1788638677.527363:0:15082:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2bebe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638677.527375:0:15082:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2bebe lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638677.527422:0:15082:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2bebe lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638677.527461:0:15082:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ae29c64/0xa0b1f1e3b4b2bebe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15082 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788638677.527823:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00000100:00100000:1.0:1788638677.528174:0:15082:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7d07480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:0a963600-85ae-4d04-99fd-4389bf419479+5:2364:x1875523174265728:12345-192.168.203.34@tcp:4:dd.0 Request processed in 118804us (257571us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788638677.528187:0:15082:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 2 00000100:00100000:3.0:1788638677.557981:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638677.558497:0:15083:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174265856 00000100:00100000:1.0:1788638677.558508:0:15083:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174265856 00000100:00100000:1.0:1788638677.558582:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 3 00000100:00100000:1.0:1788638677.558592:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0a963600-85ae-4d04-99fd-4389bf419479+5:2365:x1875523174265856:12345-192.168.203.34@tcp:4:dd.0 00002000:00010000:1.0:1788638677.558642:0:15083:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9c75d5, atime: 0x6a9c75d3, ctime: 0x0, blocks: 0x1807 00010000:00010000:1.0:1788638677.558651:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056bc17dc/0xa0b1f1e3b4b2bec5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638677.558666:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=440s v=(0 0) 00010000:00010000:1.0:1788638677.558671:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788638677.558676:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000056bc17dc/0xa0b1f1e3b4b2bec5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788638677.558691:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000056bc17dc/0xa0b1f1e3b4b2bec5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788638677.594751:0:3285:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638677.594820:0:16627:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174265984 00000100:00100000:1.0:1788638677.594829:0:16627:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174265984 00000100:00100000:0.0:1788638677.594958:0:16627:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 4 00000100:00100000:0.0:1788638677.594969:0:16627:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0a963600-85ae-4d04-99fd-4389bf419479+7:2364:x1875523174265984:12345-192.168.203.34@tcp:4:dd.0 00010000:00010000:0.0:1788638677.595003:0:16627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2becc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638677.595022:0:16627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638677.595026:0:16627:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638677.595034:0:16627:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2becc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638677.595049:0:16627:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2becc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638677.596878:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:3.0:1788638677.596931:0:15084:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1788638677.596941:0:15084:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1788638677.599368:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174266112 00000100:00100000:1.0:1788638677.599392:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174266112 00000100:00100000:2.0:1788638677.599940:0:16629:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 5 00000100:00100000:2.0:1788638677.599952:0:16629:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0a963600-85ae-4d04-99fd-4389bf419479+11:2365:x1875523174266112:12345-192.168.203.34@tcp:4:dd.0 00010000:00010000:2.0:1788638677.599984:0:16629:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000debe86e7/0xa0b1f1e3b4b2bed3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.600011:0:16629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788638677.600017:0:16629:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788638677.600023:0:16629:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000debe86e7/0xa0b1f1e3b4b2bed3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.600036:0:16629:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000debe86e7/0xa0b1f1e3b4b2bed3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788638677.624221:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638677.626676:0:3284:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638677.627184:0:15084:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1788638677.627483:0:15082:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1788638677.627590:0:15084:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:0.0:1788638677.628279:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174266240 00000100:00100000:0.0:1788638677.628288:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174266240 00000100:00100000:0.0:1788638677.628337:0:15084:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:0.0:1788638677.628345:0:15084:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174266368 00000100:00100000:0.0:1788638677.628347:0:15084:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174266368 00000100:00100000:1.0:1788638677.630212:0:16630:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 6 00000100:00100000:1.0:1788638677.630229:0:16630:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73b7d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0a963600-85ae-4d04-99fd-4389bf419479+16:2365:x1875523174266240:12345-192.168.203.34@tcp:4:dd.0 00010000:00010000:0.0:1788638677.631760:0:16630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2beda lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638677.631798:0:16630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638677.631803:0:16630:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788638677.631810:0:16630:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2beda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788638677.631825:0:16630:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2beda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788638677.659167:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:3.0:1788638677.671433:0:15083:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7340032 00002000:00010000:3.0:1788638677.671443:0:15083:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788638677 00002000:00010000:3.0:1788638677.671445:0:15083:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 14343 00010000:00010000:3.0:1788638677.671458:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000056bc17dc/0xa0b1f1e3b4b2bec5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.671470:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000056bc17dc/0xa0b1f1e3b4b2bec5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.671479:0:15083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000056bc17dc/0xa0b1f1e3b4b2bec5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.671497:0:15083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5568800 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638677.671502:0:15083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000056bc17dc/0xa0b1f1e3b4b2bec5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.671512:0:15083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000056bc17dc/0xa0b1f1e3b4b2bec5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.671531:0:15083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000056bc17dc/0xa0b1f1e3b4b2bec5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.671539:0:15083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056bc17dc/0xa0b1f1e3b4b2bec5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638677.671655:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0a963600-85ae-4d04-99fd-4389bf419479+18:2365:x1875523174265856:12345-192.168.203.34@tcp:4:dd.0 Request processed in 113059us (113677us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788638677.671664:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 3 00000100:00100000:3.0:1788638677.671697:0:15083:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 7 00000100:00100000:3.0:1788638677.671709:0:15083:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7391b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0a963600-85ae-4d04-99fd-4389bf419479+17:2364:x1875523174266368:12345-192.168.203.34@tcp:4:dd.0 00010000:00010000:3.0:1788638677.671742:0:15083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bb85398/0xa0b1f1e3b4b2bee1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.671754:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788638677.671758:0:15083:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788638677.671764:0:15083:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bb85398/0xa0b1f1e3b4b2bee1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.671775:0:15083:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bb85398/0xa0b1f1e3b4b2bee1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788638677.723236:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:2.0:1788638677.723716:0:16630:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00010000:00010000:2.0:1788638677.723732:0:16630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2beda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.723746:0:16630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2beda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.723756:0:16630:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2beda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.723763:0:16630:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466600 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638677.723768:0:16630:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2beda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.723777:0:16630:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2beda lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.723841:0:16630:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2beda lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.723849:0:16630:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096f00f39/0xa0b1f1e3b4b2beda lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638677.723932:0:16630:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73b7d07b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:0a963600-85ae-4d04-99fd-4389bf419479+13:2365:x1875523174266240:12345-192.168.203.34@tcp:4:dd.0 Request processed in 93703us (99715us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788638677.723942:0:16630:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 6 00010000:00010000:2.0:1788638677.723986:0:16627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2becc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.724069:0:16627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2becc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.724076:0:16627:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2becc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.724082:0:16627:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73b5466400 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:2.0:1788638677.724085:0:16627:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2becc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.724092:0:16627:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2becc lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.724115:0:16627:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2becc lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788638677.724123:0:16627:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f24ae11/0xa0b1f1e3b4b2becc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788638677.724156:0:16627:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:0a963600-85ae-4d04-99fd-4389bf419479+11:2364:x1875523174265984:12345-192.168.203.34@tcp:4:dd.0 Request processed in 129190us (129415us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1788638677.724164:0:16627:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 4 00002000:00010000:3.0:1788638677.725728:0:16629:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1788638677.725745:0:16629:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000debe86e7/0xa0b1f1e3b4b2bed3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.725757:0:16629:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000debe86e7/0xa0b1f1e3b4b2bed3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.725764:0:16629:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000debe86e7/0xa0b1f1e3b4b2bed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.725806:0:16629:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73bc01dc00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638677.725811:0:16629:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000debe86e7/0xa0b1f1e3b4b2bed3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.725820:0:16629:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000debe86e7/0xa0b1f1e3b4b2bed3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.725836:0:16629:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000debe86e7/0xa0b1f1e3b4b2bed3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.725845:0:16629:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000debe86e7/0xa0b1f1e3b4b2bed3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16629 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638677.725912:0:16629:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:0a963600-85ae-4d04-99fd-4389bf419479+9:2365:x1875523174266112:12345-192.168.203.34@tcp:4:dd.0 Request processed in 125959us (129038us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788638677.725921:0:16629:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 5 00010000:00010000:3.0:1788638677.762524:0:15083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bb85398/0xa0b1f1e3b4b2bee1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.762544:0:15083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bb85398/0xa0b1f1e3b4b2bee1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.762621:0:15083:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bb85398/0xa0b1f1e3b4b2bee1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.762642:0:15083:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9c73813fcc00 already unused, calling callback (ffffffffc16b24f0) 00010000:00010000:3.0:1788638677.762648:0:15083:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bb85398/0xa0b1f1e3b4b2bee1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.762656:0:15083:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bb85398/0xa0b1f1e3b4b2bee1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.762675:0:15083:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bb85398/0xa0b1f1e3b4b2bee1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788638677.762683:0:15083:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bb85398/0xa0b1f1e3b4b2bee1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15083 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788638677.762818:0:15083:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7391b4a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:0a963600-85ae-4d04-99fd-4389bf419479+7:2364:x1875523174266368:12345-192.168.203.34@tcp:4:dd.0 Request processed in 91074us (136120us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788638677.762828:0:15083:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 7 00000001:00080000:0.0:1788638677.763251:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:1.0:1788638678.048656:0:14383:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788638678.796635:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638678.796737:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638678.796769:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638678.796814:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638678.796834:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:2.0:1788638678.796851:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:1.0:1788638678.796905:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174266880 00000100:00100000:1.0:1788638678.796915:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174266880 00000100:00100000:1.0:1788638678.796964:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174267136 00000100:00100000:1.0:1788638678.796968:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174267136 00000100:00100000:1.0:1788638678.796982:0:15077:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174266752 00000100:00100000:1.0:1788638678.796985:0:15077:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174266752 00000100:00100000:1.0:1788638678.797002:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 15 00000100:00100000:1.0:1788638678.797011:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a963600-85ae-4d04-99fd-4389bf419479+5:2366:x1875523174266880:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638678.798487:0:15078:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788638678.798503:0:15078:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788638678.798750:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a963600-85ae-4d04-99fd-4389bf419479+5:2366:x1875523174266880:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 1735us (2008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638678.798761:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 15 00000100:00100000:1.0:1788638678.798806:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 16 00000100:00100000:1.0:1788638678.798816:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6181e191-5f1a-46ec-b515-69664fc84af5+5:2366:x1875523174267136:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638678.798852:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6181e191-5f1a-46ec-b515-69664fc84af5+5:2366:x1875523174267136:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 39us (2083us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638678.798858:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 16 00000100:00100000:1.0:1788638678.798870:0:15077:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 17 00000100:00100000:1.0:1788638678.798879:0:15077:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a963600-85ae-4d04-99fd-4389bf419479+5:2366:x1875523174266752:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638678.798903:0:15077:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0a963600-85ae-4d04-99fd-4389bf419479+5:2366:x1875523174266752:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 26us (2068us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638678.798926:0:15077:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 17 00000100:00080000:1.0:1788638678.798945:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788638678.798949:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788638678.798983:0:14389:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174266496 00000100:00100000:1.0:1788638678.798996:0:14389:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174266496 00000100:00100000:1.0:1788638678.799030:0:14389:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 121 00000100:00100000:1.0:1788638678.799037:0:14389:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:2366:x1875523174266496:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:1.0:1788638678.799064:0:14389:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f4ea1363-ddd7-45b0-8012-313d4f61213a+13:2366:x1875523174266496:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 27us (2249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638678.799070:0:14389:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 121 00000100:00100000:2.0:1788638678.804643:0:3286:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.34@tcp (source: 12345-192.168.203.34@tcp) 00000100:00100000:0.0:1788638678.804860:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174267264 00000100:00100000:0.0:1788638678.804870:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174267264 00000100:00100000:0.0:1788638678.804932:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 18 00000100:00100000:0.0:1788638678.804942:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6181e191-5f1a-46ec-b515-69664fc84af5+5:2366:x1875523174267264:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:0.0:1788638678.805024:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6181e191-5f1a-46ec-b515-69664fc84af5+5:2366:x1875523174267264:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 83us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638678.805045:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 18 00000100:00100000:3.0:1788638678.805604:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174266624 00000100:00100000:3.0:1788638678.805611:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174266624 00000100:00100000:3.0:1788638678.805651:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523174267008 00000100:00100000:3.0:1788638678.805654:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523174267008 00000100:00100000:3.0:1788638678.805677:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 29 00000100:00100000:3.0:1788638678.805685:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+20:2366:x1875523174266624:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638678.805732:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0a963600-85ae-4d04-99fd-4389bf419479+20:2366:x1875523174266624:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 47us (9105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638678.805740:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 29 00000100:00100000:3.0:1788638678.805763:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.34@tcp, seq: 30 00000100:00100000:3.0:1788638678.805770:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6181e191-5f1a-46ec-b515-69664fc84af5+6:2366:x1875523174267008:12345-192.168.203.34@tcp:400:kworker.0 00000100:00100000:3.0:1788638678.805823:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6181e191-5f1a-46ec-b515-69664fc84af5+6:2366:x1875523174267008:12345-192.168.203.34@tcp:400:kworker.0 Request processed in 54us (8971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788638678.805830:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.34@tcp, seq: 30 00000100:00080000:2.0:1788638678.806826:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788638678.806833:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788638679.072996:0:14384:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788638679.302813:0:16668:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:2.0:1788638679.778355:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c7384c28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183686272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788638679.778437:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638679.779026:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183686272 00000100:00100000:0.0:1788638679.779035:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183686272 00000100:00100000:0.0:1788638679.779101:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788638679.779110:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73837a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183686272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788638679.779145:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1788638679.779206:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73837a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3294:x1875523183686272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638679.779213:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788638679.779329:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788638679.779950:0:3294:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:2.0:1788638679.779957:0:3294:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9c73837a5f80, transno 8589934595 00000004:00080000:2.0:1788638679.779972:0:3294:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1788638679.780000:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c7384c28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3294:1875523183686272:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788638680.096689:0:15767:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788638680.288143:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183686400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788638680.288215:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788638680.288556:0:15081:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183686400 00000100:00100000:2.0:1788638680.288564:0:15081:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183686400 00000100:00100000:2.0:1788638680.288642:0:15081:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788638680.288652:0:15081:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183686400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788638680.288697:0:15081:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788638680.288749:0:15081:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c2b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3291:x1875523183686400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788638680.288757:0:15081:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788638680.288868:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788638680.289040:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3291:1875523183686400:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788638680.289391:0:3293:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183686656:0@lo:400:kworker.0 00000100:00100000:3.0:1788638680.289438:0:3293:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638680.289537:0:3291:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788638680.289547:0:3291:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183686528:0@lo:400:kworker.0 00000100:00100000:0.0:1788638680.289579:0:3291:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638680.289710:0:14387:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183686528 00000100:00100000:0.0:1788638680.289715:0:14387:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183686528 00000100:00100000:0.0:1788638680.289745:0:14387:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788638680.289752:0:14387:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384dccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3291:x1875523183686528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638680.289836:0:14387:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384dccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d97ff07e-b3b5-4ef8-bed3-2a6960653930+19:3291:x1875523183686528:12345-0@lo:400:kworker.0 Request processed in 84us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638680.289844:0:14387:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788638680.289878:0:3291:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d97ff07e-b3b5-4ef8-bed3-2a6960653930:3291:1875523183686528:0@lo:400:kworker.0 00000100:00100000:0.0:1788638680.289895:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183686784:0@lo:400:kworker.0 00000100:00100000:0.0:1788638680.289921:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788638680.289973:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183686784 00000100:00100000:0.0:1788638680.289978:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183686784 00000100:00100000:0.0:1788638680.290005:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788638680.290011:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7384c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183686784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788638680.290045:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7384c2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875523183686784:12345-0@lo:400:kworker.0 Request processed in 34us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638680.290052:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788638680.290068:0:15078:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183686656 00000100:00100000:0.0:1788638680.290071:0:15078:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183686656 00000100:00100000:0.0:1788638680.290093:0:15078:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788638680.290099:0:15078:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183686656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638680.290529:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875523183686784:0@lo:400:kworker.0 00000100:00100000:1.0:1788638680.295608:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1875523183687040:0@lo:400:kworker.0 00000100:00100000:1.0:1788638680.295699:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638680.295749:0:3292:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788638680.295756:0:3292:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9c73837a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183686912:0@lo:400:kworker.0 00000100:00100000:1.0:1788638680.295823:0:3292:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788638680.295859:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183687040 00000100:00100000:1.0:1788638680.295866:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183687040 00000100:00100000:1.0:1788638680.295919:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875523183686912 00000100:00100000:1.0:1788638680.295922:0:14397:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875523183686912 00000100:00100000:1.0:1788638680.295944:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788638680.295953:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c7387d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875523183687040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638680.295999:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387d9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3292:x1875523183687040:12345-0@lo:400:kworker.0 Request processed in 47us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638680.296007:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788638680.296038:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788638680.296044:0:14397:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9c73ad30c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183686912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788638680.296072:0:14397:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c73ad30c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3292:x1875523183686912:12345-0@lo:400:kworker.0 Request processed in 28us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788638680.296078:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788638680.296118:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3292:1875523183686912:0@lo:400:kworker.0 00000100:00100000:1.0:1788638680.296128:0:3292:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3292:1875523183687040:0@lo:400:kworker.0 00000100:00080000:2.0:1788638680.297577:0:14390:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788638680.301547:0:15078:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9c7387dbdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3293:x1875523183686656:12345-0@lo:400:kworker.0 Request processed in 11436us (12096us total) trans 0 rc 0/0 00000100:00100000:0.0:1788638680.301563:0:15078:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788638680.304545:0:3293:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9c73837a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3293:1875523183686656:0@lo:400:kworker.0 Debug log: 29813 lines, 29813 kept, 0 dropped, 0 bad.