00000020:01000004:1.0F:1790964072.542716:0:32572:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1790964072.542739:0:32572:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1790964072.542859:0:32572:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000010e558e2 00000080:02000400:1.0:1790964072.542871:0:32572:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1790964072.568639:0:32572:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1790964072.568652:0:32572:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1790964072.568690:0:32572:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000004e5fb0f3) 00000020:00000080:1.0:1790964072.568707:0:32572:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0F:1790964072.641378:0:32572:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0F:1790964072.664591:0:32572:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x36:0x0] (8/32) 00100000:10000000:2.0:1790964072.666029:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 561: rc = 0 00100000:10000000:2.0:1790964072.667081:0:32572:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1790964072.667228:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 561: rc = 0 00100000:10000000:2.0:1790964072.668299:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0001 under 561: rc = 0 00100000:10000000:2.0:1790964072.668943:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 561: rc = 0 00100000:10000000:2.0:1790964072.669047:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 561: rc = 0 00100000:10000000:2.0:1790964072.669159:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 561: rc = 0 00100000:10000000:2.0:1790964072.670644:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 563: rc = 0 00100000:10000000:3.0:1790964072.676445:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 414: rc = 0 00100000:10000000:3.0:1790964072.676777:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 414: rc = 0 00100000:10000000:3.0:1790964072.680699:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 314: rc = 0 00100000:10000000:3.0:1790964072.682020:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 314: rc = 0 00100000:10000000:3.0:1790964072.684785:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 314: rc = 0 00100000:10000000:3.0:1790964072.686409:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 314: rc = 0 00100000:10000000:3.0:1790964072.688197:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 314: rc = 0 00100000:10000000:3.0:1790964072.689842:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 314: rc = 0 00100000:10000000:3.0:1790964072.691255:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 314: rc = 0 00100000:10000000:3.0:1790964072.696947:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 314: rc = 0 00100000:10000000:3.0:1790964072.698301:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 314: rc = 0 00100000:10000000:3.0:1790964072.700799:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 314: rc = 0 00100000:10000000:0.0F:1790964072.712768:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 314: rc = 0 00100000:10000000:1.0:1790964072.720594:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 314: rc = 0 00100000:10000000:1.0:1790964072.726277:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 427: rc = 0 00100000:10000000:1.0:1790964072.727924:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 427: rc = 0 00100000:10000000:1.0:1790964072.729471:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 427: rc = 0 00100000:10000000:1.0:1790964072.731259:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 427: rc = 0 00100000:10000000:1.0:1790964072.732686:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 427: rc = 0 00100000:10000000:2.0:1790964072.740838:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 427: rc = 0 00100000:10000000:2.0:1790964072.744702:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 427: rc = 0 00100000:10000000:1.0:1790964072.749337:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 427: rc = 0 00100000:10000000:1.0:1790964072.753176:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 427: rc = 0 00100000:10000000:1.0:1790964072.757946:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 427: rc = 0 00100000:10000000:1.0:1790964072.760697:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 427: rc = 0 00100000:10000000:1.0:1790964072.762004:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 427: rc = 0 00100000:10000000:1.0:1790964072.770406:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 427: rc = 0 00100000:10000000:1.0:1790964072.774787:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 427: rc = 0 00100000:10000000:1.0:1790964072.776431:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 427: rc = 0 00100000:10000000:2.0:1790964072.783703:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 427: rc = 0 00100000:10000000:3.0:1790964072.798106:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 427: rc = 0 00100000:10000000:3.0:1790964072.803335:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 427: rc = 0 00100000:10000000:3.0:1790964072.805448:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 427: rc = 0 00100000:10000000:3.0:1790964072.807032:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 427: rc = 0 00100000:10000000:3.0:1790964072.809240:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 427: rc = 0 00100000:10000000:3.0:1790964072.810894:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 427: rc = 0 00100000:10000000:2.0:1790964072.812610:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 427: rc = 0 00100000:10000000:2.0:1790964072.814011:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 427: rc = 0 00100000:10000000:2.0:1790964072.823834:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 427: rc = 0 00100000:10000000:2.0:1790964072.826861:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 427: rc = 0 00100000:10000000:2.0:1790964072.830443:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 427: rc = 0 00100000:10000000:3.0:1790964072.851063:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 427: rc = 0 00100000:10000000:3.0:1790964072.856026:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 427: rc = 0 00100000:10000000:3.0:1790964072.857706:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 427: rc = 0 00100000:10000000:3.0:1790964072.863658:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 427: rc = 0 00100000:10000000:3.0:1790964072.865173:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 427: rc = 0 00100000:10000000:3.0:1790964072.870694:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000401:0x1:0x0] under 691: rc = 0 00100000:10000000:2.0:1790964072.872455:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 691: rc = 0 00100000:10000000:2.0:1790964072.878213:0:32572:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1790964072.880958:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 415: rc = 0 00100000:10000000:2.0:1790964072.882268:0:32572:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1790964072.882359:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 415: rc = 0 00100000:10000000:2.0:1790964072.884066:0:32572:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1790964072.884231:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 415: rc = 0 00100000:10000000:2.0:1790964072.886758:0:32572:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1790964072.886856:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 311: rc = 0 00100000:10000000:0.0:1790964072.888072:0:32572:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1790964072.888253:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 311: rc = 0 00100000:10000000:0.0:1790964072.889391:0:32572:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:0.0:1790964072.889476:0:32572:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 311: rc = 0 00000020:00000080:0.0:1790964072.889865:0:32572:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1790964072.889874:0:32572:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:0.0:1790964072.889884:0:32572:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6a601b0c127d504f 00000020:01000004:0.0:1790964072.889892:0:32572:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:0.0:1790964072.889898:0:32572:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1790964072.889902:0:32572:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000010e558e2 from MGS 00000020:01000004:0.0:1790964072.889907:0:32572:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1790964072.889926:0:32572:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000006f2e245d) 00000020:00000080:0.0:1790964072.889937:0:32572:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1790964072.889997:0:32572:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000010e558e2 from MGS, refs=2 00080000:01000000:0.0:1790964072.890002:0:32572:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1790964072.890007:0:32572:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6a601b0c127d505d 00000100:00100000:0.0:1790964072.890200:0:32572:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1790964072.890347:0:32572:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1790964072.890353:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1790964072.890953:0:32572:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1790964072.890960:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1790964072.891998:0:32572:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790964072.892243:0:32572:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1790964072.892249:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1790964072.893026:0:32572:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1790964072.893033:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1790964072.893395:0:32572:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1790964072.893401:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1790964072.894273:0:32578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790964072.894277:0:32578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790964072.894284:0:32578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790964072.894807:0:32579:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790964072.894810:0:32579:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1790964072.894812:0:32579:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790964072.895365:0:32572:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1790964072.896791:0:32578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1790964073.144649:0:32572:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2711 MB/s 00000001:01000000:0.0:1790964073.395551:0:32572:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3043 MB/s 00000001:01000000:2.0:1790964073.648024:0:32572:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 654 MB/s 00000001:01000000:2.0:1790964073.898299:0:32572:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 515 MB/s 00010000:00010000:0.0:1790964073.909673:0:32579:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1790964073.929575:0:32572:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1790964073.929593:0:32572:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1790964073.929596:0:32572:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1790964073.947934:0:32581:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1790964073.949440:0:32572:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1790964073.949614:0:32572:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1790964073.949822:0:32572:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1790964073.949904:0:32572:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1790964073.951446:0:32572:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1790964073.952020:0:32572:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1790964073.952028:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1790964073.953398:0:32572:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1790964073.953409:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1790964073.953943:0:32572:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1790964073.953951:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:3.0:1790964073.957121:0:32586:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:1.0:1790964073.957176:0:32572:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1790964073.957235:0:32572:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.147@tcp' 00000020:01000004:1.0:1790964073.957237:0:32572:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1790964073.957290:0:32572:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.147@tcp (typ=mgc) 00000020:00000080:1.0:1790964073.957303:0:32572:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.147@tcp (0000000084df6c96) 00000020:00000080:1.0:1790964073.957321:0:32572:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1790964073.957415:0:32572:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000f7398c40@MGC192.168.201.147@tcp: add connection 192.168.201.147@tcp at head 00010000:00010000:1.0:1790964073.957714:0:32572:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.147@tcp-0 is initialized 00000040:01000000:1.0:1790964073.957721:0:32572:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.147@tcp ctxt 1 is initialized 10000000:01000000:2.0:1790964073.959139:0:32587:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1790964073.959615:0:32572:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.147@tcp (uuid e5c322e7-c837-4fbe-89d7-d887ea2ad81f) 00000020:00000080:1.0:1790964073.959637:0:32572:0:(genops.c:1385:class_connect()) connect: client e5c322e7-c837-4fbe-89d7-d887ea2ad81f, cookie 0x6a601b0c127d506b 00000100:00080000:1.0:1790964073.959649:0:32572:0:(import.c:545:import_select_connection()) MGC192.168.201.147@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1790964073.959654:0:32572:0:(import.c:665:import_select_connection()) MGC192.168.201.147@tcp: import 00000000f7398c40 using connection 192.168.201.147@tcp/0@lo 00000100:00100000:1.0:1790964073.959686:0:32572:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000ecc2ee7 x1877961927032960/t0(0) o250->MGC192.168.201.147@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1790964073.959713:0:32572:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import e5c322e7-c837-4fbe-89d7-d887ea2ad81f->MGS 00000020:01000004:1.0:1790964073.959734:0:32572:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1790964073.959738:0:32572:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1790964073.959751:0:32572:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000005d3b6398) 00000020:00000080:1.0:1790964073.959760:0:32572:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1790964073.964197:0:31726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ecc2ee7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:31726:1877961927032960:0@lo:250: 00000100:00100000:0.0:1790964073.964292:0:31726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790964073.964377:0:32583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927032960 00000100:00100000:0.0:1790964073.964385:0:32583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927032960 00000100:00100000:0.0:1790964073.964425:0:32583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790964073.964435:0:32583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000291e5e08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:31726:x1877961927032960:12345-0@lo:250: 00010000:00080000:0.0:1790964073.964465:0:32583:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e5c322e7-c837-4fbe-89d7-d887ea2ad81f@0@lo t0 exp 0000000000000000 cur 935 last 0 00000020:00000080:0.0:1790964073.964514:0:32583:0:(genops.c:1385:class_connect()) connect: client e5c322e7-c837-4fbe-89d7-d887ea2ad81f, cookie 0x6a601b0c127d5079 00000100:00080000:0.0:1790964073.964674:0:32583:0:(import.c:65:import_set_state_nolock()) 0000000096c5446e : changing import state from RECOVER to FULL 00000100:00100000:0.0:1790964073.964737:0:32583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000291e5e08 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+5:31726:x1877961927032960:12345-0@lo:250: Request processed in 303us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964073.964744:0:32583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790964073.964798:0:31726:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.201.147@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1790964073.964810:0:31726:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.201.147@tcp: connect to target with instance 0 00000100:00080000:0.0:1790964073.964818:0:31726:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.201.147@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1790964073.964825:0:31726:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1790964073.964828:0:31726:0:(import.c:65:import_set_state_nolock()) 00000000f7398c40 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1790964073.964830:0:31726:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1790964073.964844:0:31726:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1790964073.964848:0:31726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ecc2ee7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:31726:1877961927032960:0@lo:250: 00000100:00100000:1.0:1790964073.972266:0:32572:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1790964073.972472:0:32572:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1790964073.972515:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1790964073.974822:0:32572:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1790964073.974835:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1790964073.976574:0:32572:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1790964073.976587:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1790964073.978243:0:32572:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790964073.978422:0:32572:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1790964073.978427:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1790964073.979304:0:32572:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1790964073.979312:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1790964074.010949:0:32572:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790964074.011182:0:32572:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1790964074.011187:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1790964074.012780:0:32572:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1790964074.012792:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1790964074.014768:0:32572:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790964074.014973:0:32572:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790964074.014986:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1790964074.016192:0:32572:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790964074.016205:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1790964074.017044:0:32572:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790964074.017230:0:32572:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790964074.017236:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1790964074.018476:0:32572:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1790964074.018624:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1790964074.019581:0:32572:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790964074.022536:0:32572:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1790964074.022546:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1790964074.024858:0:32572:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1790964074.024876:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1790964074.063780:0:32572:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1790964074.064346:0:32572:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1790964074.064353:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1790964074.067211:0:32572:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1790964074.067234:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1790964074.069915:0:32572:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1790964074.069932:0:32572:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1790964074.072341:0:32572:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1790964074.072421:0:32572:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1790964074.072438:0:32572:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.147@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1790964074.072882:0:32572:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.147@tcp ctxt 0 is initialized 00000020:01000004:2.0:1790964074.072920:0:32572:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.147@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1790964074.072925:0:32572:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1790964074.072927:0:32572:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790964074.072928:0:32572:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790964074.072929:0:32572:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790964074.072930:0:32572:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790964074.072932:0:32572:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790964074.072933:0:32572:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790964074.072934:0:32572:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790964074.072936:0:32572:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790964074.072937:0:32572:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790964074.072940:0:32572:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1790964074.072942:0:32572:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1790964074.072943:0:32572:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790964074.072944:0:32572:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790964074.072945:0:32572:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790964074.072946:0:32572:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790964074.072947:0:32572:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790964074.072948:0:32572:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790964074.072949:0:32572:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790964074.072954:0:32572:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790964074.072954:0:32572:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1790964074.072983:0:32572:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1790964074.073007:0:32572:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005183f54b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927033088:0@lo:253: 00000100:00100000:2.0:1790964074.073187:0:32572:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964074.073300:0:32572:0:(client.c:2716:ptlrpc_set_wait()) set 000000000511c1a1 going to sleep for 11 seconds 00000100:00100000:3.0:1790964074.074354:0:32585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927033088 00000100:00100000:3.0:1790964074.074368:0:32585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927033088 00000100:00100000:3.0:1790964074.074511:0:32585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1790964074.074521:0:32585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b927bac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+5:32572:x1877961927033088:12345-0@lo:253: 20000000:01000000:3.0:1790964074.074596:0:32585:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1790964074.074599:0:32585:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1790964074.074603:0:32585:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1790964074.075585:0:32606:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1790964074.075997:0:32585:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 8 20000000:01000000:3.0:1790964074.085025:0:32609:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1790964074.085036:0:32609:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1790964074.085040:0:32609:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 00000040:00080000:3.0:1790964074.085199:0:32609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 20000000:01000000:1.0:1790964074.085591:0:32585:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1790964074.085614:0:32585:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1790964074.119232:0:32585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b927bac pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+5:32572:x1877961927033088:12345-0@lo:253: Request processed in 44700us (46032us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964074.119257:0:32585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1790964074.119452:0:32572:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005183f54b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927033088:0@lo:253: 10000000:01000000:2.0:1790964074.119474:0:32572:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1790964074.119511:0:32572:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1790964074.119515:0:32572:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1790964074.119517:0:32572:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1790964074.119518:0:32572:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1790964074.119519:0:32572:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1790964074.119520:0:32572:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1790964074.119522:0:32572:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1790964074.119523:0:32572:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1790964074.119525:0:32572:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1790964074.119527:0:32572:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1790964074.119563:0:32572:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000010e558e2 from lustre-MDT0000 10000000:01000000:2.0:1790964074.119598:0:32572:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1790964074.119603:0:32572:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790964074.119607:0:32572:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff97f07a188000 10000000:01000000:2.0:1790964074.119614:0:32572:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790964074.119623:0:32572:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff97f07a188000 from 1 10000000:01000000:2.0:1790964074.119625:0:32572:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1790964074.119678:0:32572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.147@tcp lock: 000000000d279b0d/0x6a601b0c127d5080 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964074.119690:0:32572:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.147@tcp lock: 000000000d279b0d/0x6a601b0c127d5080 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964074.119700:0:32572:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.147@tcp lock: 000000000d279b0d/0x6a601b0c127d5080 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964074.119734:0:32572:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005183f54b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927033216:0@lo:101: 00000100:00100000:2.0:1790964074.119796:0:32572:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964074.119867:0:32572:0:(client.c:2716:ptlrpc_set_wait()) set 000000000511c1a1 going to sleep for 11 seconds 00000100:00100000:0.0:1790964074.120209:0:32584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927033216 00000100:00100000:0.0:1790964074.120217:0:32584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927033216 00000100:00100000:0.0:1790964074.120263:0:32584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1790964074.120272:0:32584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003916ad6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+5:32572:x1877961927033216:12345-0@lo:101: 00010000:00010000:0.0:1790964074.120287:0:32584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790964074.120307:0:32584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c1276cf0/0x6a601b0c127d5087 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a601b0c127d5080 expref: -99 pid: 32584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964074.120333:0:32584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c1276cf0/0x6a601b0c127d5087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6a601b0c127d5080 expref: 6 pid: 32584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964074.120346:0:32584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c1276cf0/0x6a601b0c127d5087 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6a601b0c127d5080 expref: 6 pid: 32584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964074.120356:0:32584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c1276cf0, rc 0) 00000100:00100000:0.0:1790964074.120402:0:32584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003916ad6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+6:32572:x1877961927033216:12345-0@lo:101: Request processed in 131us (606us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964074.120409:0:32584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1790964074.120622:0:32572:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005183f54b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927033216:0@lo:101: 00010000:00010000:2.0:1790964074.120636:0:32572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.147@tcp lock: 000000000d279b0d/0x6a601b0c127d5080 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6a601b0c127d5087 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964074.120645:0:32572:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.147@tcp lock: 000000000d279b0d/0x6a601b0c127d5080 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6a601b0c127d5087 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964074.120702:0:32572:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005183f54b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927033344:0@lo:501: 00000100:00100000:2.0:1790964074.120728:0:32572:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964074.120759:0:32572:0:(client.c:2716:ptlrpc_set_wait()) set 000000000511c1a1 going to sleep for 11 seconds 00000100:00100000:3.0:1790964074.120804:0:32585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927033344 00000100:00100000:3.0:1790964074.120819:0:32585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927033344 00000100:00100000:3.0:1790964074.120860:0:32585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1790964074.120866:0:32585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dfbaa3ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+6:32572:x1877961927033344:12345-0@lo:501: 00000100:00100000:3.0:1790964074.121334:0:32585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dfbaa3ea pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+6:32572:x1877961927033344:12345-0@lo:501: Request processed in 466us (604us total) trans 0 rc -2/-2 00000100:00100000:3.0:1790964074.121342:0:32585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1790964074.121411:0:32572:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005183f54b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927033344:0@lo:501: 10000000:01000000:2.0:1790964074.121439:0:32572:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.147@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1790964074.121458:0:32572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.147@tcp lock: 000000000d279b0d/0x6a601b0c127d5080 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6a601b0c127d5087 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964074.121468:0:32572:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.147@tcp lock: 000000000d279b0d/0x6a601b0c127d5080 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6a601b0c127d5087 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790964074.121506:0:32572:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff97ef487e6000 10000000:01000000:2.0:1790964074.121512:0:32572:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1790964074.121517:0:32572:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff97ef487e6000 10000000:01000000:2.0:1790964074.121520:0:32572:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1790964074.121523:0:32572:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff97ef487e6000 from 1 10000000:01000000:2.0:1790964074.121533:0:32572:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1790964074.121559:0:32572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.147@tcp lock: 00000000f44f8c6a/0x6a601b0c127d508e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964074.121567:0:32572:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.147@tcp lock: 00000000f44f8c6a/0x6a601b0c127d508e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964074.121575:0:32572:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.147@tcp lock: 00000000f44f8c6a/0x6a601b0c127d508e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964074.121589:0:32572:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005183f54b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927033472:0@lo:101: 00000100:00100000:2.0:1790964074.121617:0:32572:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964074.121696:0:32572:0:(client.c:2716:ptlrpc_set_wait()) set 000000000511c1a1 going to sleep for 11 seconds 00000100:00100000:0.0:1790964074.121949:0:32583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927033472 00000100:00100000:0.0:1790964074.121957:0:32583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927033472 00000100:00100000:0.0:1790964074.122150:0:32583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1790964074.122159:0:32583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003754b145 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+6:32572:x1877961927033472:12345-0@lo:101: 00010000:00010000:0.0:1790964074.122169:0:32583:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1790964074.122183:0:32583:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003bc499c3/0x6a601b0c127d5095 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a601b0c127d508e expref: -99 pid: 32583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964074.122204:0:32583:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003bc499c3/0x6a601b0c127d5095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6a601b0c127d508e expref: 7 pid: 32583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964074.122214:0:32583:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003bc499c3/0x6a601b0c127d5095 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6a601b0c127d508e expref: 7 pid: 32583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1790964074.122221:0:32583:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003bc499c3, rc 0) 00000100:00100000:0.0:1790964074.122311:0:32583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003754b145 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+7:32572:x1877961927033472:12345-0@lo:101: Request processed in 154us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964074.122318:0:32583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1790964074.122384:0:32572:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005183f54b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927033472:0@lo:101: 00010000:00010000:2.0:1790964074.122398:0:32572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.147@tcp lock: 00000000f44f8c6a/0x6a601b0c127d508e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6a601b0c127d5095 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964074.122406:0:32572:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.147@tcp lock: 00000000f44f8c6a/0x6a601b0c127d508e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6a601b0c127d5095 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790964074.122421:0:32572:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.147@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1790964074.122461:0:32572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.147@tcp lock: 00000000f44f8c6a/0x6a601b0c127d508e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6a601b0c127d5095 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964074.122469:0:32572:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.147@tcp lock: 00000000f44f8c6a/0x6a601b0c127d508e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6a601b0c127d5095 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790964074.122476:0:32572:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1790964074.122512:0:32572:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1790964074.122517:0:32572:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff97ef487e6000 10000000:01000000:2.0:1790964074.122531:0:32572:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1790964074.122534:0:32572:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1790964074.122537:0:32572:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1790964074.122558:0:32572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.147@tcp lock: 00000000b5959221/0x6a601b0c127d509c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964074.122565:0:32572:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.147@tcp lock: 00000000b5959221/0x6a601b0c127d509c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964074.122572:0:32572:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.147@tcp lock: 00000000b5959221/0x6a601b0c127d509c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1790964074.122591:0:32572:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000005183f54b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927033600:0@lo:101: 00000100:00100000:2.0:1790964074.122621:0:32572:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964074.122648:0:32572:0:(client.c:2716:ptlrpc_set_wait()) set 000000000511c1a1 going to sleep for 11 seconds 00000100:00100000:1.0:1790964074.122725:0:32585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927033600 00000100:00100000:1.0:1790964074.122730:0:32585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927033600 00000100:00100000:1.0:1790964074.122873:0:32585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1790964074.122881:0:32585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000008e4257e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+7:32572:x1877961927033600:12345-0@lo:101: 00010000:00010000:1.0:1790964074.122891:0:32585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790964074.122907:0:32585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007ae57188/0x6a601b0c127d50a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a601b0c127d509c expref: -99 pid: 32585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964074.122922:0:32585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007ae57188/0x6a601b0c127d50a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6a601b0c127d509c expref: 8 pid: 32585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964074.122929:0:32585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007ae57188/0x6a601b0c127d50a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6a601b0c127d509c expref: 8 pid: 32585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964074.122935:0:32585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007ae57188, rc 0) 00000100:00100000:1.0:1790964074.122998:0:32585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000008e4257e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+8:32572:x1877961927033600:12345-0@lo:101: Request processed in 118us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964074.123004:0:32585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1790964074.123216:0:32572:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000005183f54b pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927033600:0@lo:101: 00010000:00010000:3.0:1790964074.123228:0:32572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.147@tcp lock: 00000000b5959221/0x6a601b0c127d509c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6a601b0c127d50a3 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964074.123244:0:32572:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.147@tcp lock: 00000000b5959221/0x6a601b0c127d509c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x6a601b0c127d50a3 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790964074.123301:0:32572:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000752f663e pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927033728:0@lo:501: 00000100:00100000:3.0:1790964074.123334:0:32572:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964074.123658:0:32572:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a68b6bef going to sleep for 11 seconds 00000100:00100000:0.0:1790964074.123713:0:32583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927033728 00000100:00100000:0.0:1790964074.123720:0:32583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927033728 00000100:00100000:0.0:1790964074.123750:0:32583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1790964074.123758:0:32583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aa9a7366 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+8:32572:x1877961927033728:12345-0@lo:501: 00000100:00100000:0.0:1790964074.124293:0:32583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aa9a7366 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+9:32572:x1877961927033728:12345-0@lo:501: Request processed in 535us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964074.124304:0:32583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1790964074.124737:0:32572:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000752f663e pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927033728:0@lo:501: 00000100:00100000:3.0:1790964074.124790:0:32572:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000752f663e pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927033856:0@lo:503: 00000100:00100000:3.0:1790964074.124854:0:32572:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964074.124880:0:32572:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a68b6bef going to sleep for 11 seconds 00000100:00100000:0.0:1790964074.125005:0:32583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927033856 00000100:00100000:0.0:1790964074.125127:0:32583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927033856 00000100:00100000:0.0:1790964074.125173:0:32583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1790964074.125180:0:32583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de4177e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+9:32572:x1877961927033856:12345-0@lo:503: 00000100:00100000:0.0:1790964074.132402:0:32583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de4177e0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+9:32572:x1877961927033856:12345-0@lo:503: Request processed in 7211us (7536us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964074.132424:0:32583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1790964074.132628:0:32572:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000752f663e pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927033856:0@lo:503: 00000100:00100000:1.0:1790964074.133248:0:32611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b2d37c3a pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32611:1877961927033984:0@lo:502: 00000100:00100000:1.0:1790964074.133313:0:32611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964074.133419:0:32611:0:(client.c:2716:ptlrpc_set_wait()) set 000000003ffbbf01 going to sleep for 11 seconds 00000100:00100000:2.0:1790964074.133549:0:32584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927033984 00000100:00100000:2.0:1790964074.133558:0:32584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927033984 00000100:00100000:2.0:1790964074.133662:0:32584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1790964074.133672:0:32584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000519b2cd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+9:32611:x1877961927033984:12345-0@lo:502: 00000100:00100000:2.0:1790964074.135679:0:32584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000519b2cd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+9:32611:x1877961927033984:12345-0@lo:502: Request processed in 2000us (2358us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964074.135696:0:32584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1790964074.136130:0:32611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b2d37c3a pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32611:1877961927033984:0@lo:502: 00000020:01000000:1.0:1790964074.136170:0:32611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790964074.136182:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790964074.136184:0:32611:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790964074.136189:0:32611:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1790964074.136191:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790964074.136204:0:32611:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000000157112f) 00000020:00000080:1.0:1790964074.136230:0:32611:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1790964074.136237:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1790964074.136326:0:32611:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1790964074.136333:0:32611:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6a601b0c127d50b1 00000020:00000080:1.0:1790964074.136599:0:32611:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1790964074.136604:0:32611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1790964074.136608:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790964074.136609:0:32611:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1790964074.136612:0:32611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1790964074.136615:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1790964074.136616:0:32611:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1790964074.136620:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1790964074.136636:0:32611:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000004b9db861) 00000020:00000080:1.0:1790964074.136646:0:32611:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1790964074.136651:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1790964074.136652:0:32611:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1790964074.136655:0:32611:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1790964074.136661:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1790964074.136711:0:32611:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000010e558e2 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1790964074.136725:0:32611:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000009c23d5ca) 00000020:00000080:1.0:1790964074.136734:0:32611:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1790964074.136787:0:32611:0:(lod_dev.c:2309:lod_obd_connect()) connect #0 00000020:00000080:1.0:1790964074.136794:0:32611:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6a601b0c127d50c6 00000020:00000080:1.0:1790964074.137179:0:32611:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1790964074.137186:0:32611:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1790964074.137191:0:32611:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x6a601b0c127d50cd 00080000:01000000:1.0:1790964074.137196:0:32611:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1790964074.137199:0:32611:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6a601b0c127d50d4 00010000:00010000:2.0:1790964074.208415:0:32611:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1790964074.210441:0:32611:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934593 00000001:00080000:2.0:1790964074.210953:0:32611:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1790964074.212188:0:32611:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000009eb98076) 00000020:00000080:2.0:1790964074.212211:0:32611:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1790964074.212327:0:32611:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:2.0:1790964074.212336:0:32611:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6a601b0c127d50e2 00000020:00000080:2.0:1790964074.212965:0:32611:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1790964074.223403:0:32611:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x6a601b0c127d50e9 00000020:00000080:3.0:1790964074.227827:0:32611:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1790964074.227849:0:32611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790964074.227861:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964074.227863:0:32611:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1790964074.227868:0:32611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790964074.227871:0:32611:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1790964074.227872:0:32611:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790964074.227873:0:32611:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790964074.227875:0:32611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790964074.227877:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964074.227878:0:32611:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790964074.227881:0:32611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790964074.227887:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964074.227888:0:32611:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1790964074.227893:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1790964074.227937:0:32611:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1790964074.227969:0:32611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790964074.227972:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964074.227973:0:32611:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1790964074.227975:0:32611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1790964074.227978:0:32611:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1790964074.227981:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964074.227982:0:32611:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1790964074.227985:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790964074.227990:0:32611:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.147@tcp to nid 0x20000c0a8c993 (192.168.201.147@tcp) 00000020:01000000:3.0:1790964074.228016:0:32611:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1790964074.228019:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790964074.228046:0:32611:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (00000000778e91da) 00000020:00000080:3.0:1790964074.228065:0:32611:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1790964074.228071:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790964074.228153:0:32611:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1790964074.228158:0:32611:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:3.0:1790964074.228165:0:32611:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6a601b0c127d50f7 00010000:00080000:3.0:1790964074.228193:0:32611:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000a5292057@lustre-OST0000-osc-MDT0000: add connection 192.168.201.147@tcp at head 00010000:00010000:3.0:1790964074.228411:0:32611:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1790964074.228780:0:32611:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1790964074.228818:0:32611:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1790964074.231664:0:32611:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790964074.232365:0:32611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:3.0:1790964074.232448:0:32611:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1790964074.232870:0:32615:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1790964074.232875:0:32615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x7:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1790964074.233691:0:32611:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1790964074.233705:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1790964074.233739:0:32611:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1790964074.233758:0:32611:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6a601b0c127d50fe 00000100:00080000:3.0:1790964074.233768:0:32611:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790964074.233774:0:32611:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import 00000000a5292057 using connection 192.168.201.147@tcp/0@lo 00000100:00100000:3.0:1790964074.233995:0:32611:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000752f663e x1877961927034112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790964074.234032:0:32611:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1790964074.234144:0:31726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000752f663e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31726:1877961927034112:0@lo:8: 00000400:00000100:2.0:1790964074.234203:0:31726:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877961927034112 offset 0 length 520: 4 00000020:01000000:3.0:1790964074.234289:0:32611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1790964074.234293:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964074.234295:0:32611:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1790964074.234298:0:32611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1790964074.234300:0:32611:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1790964074.234302:0:32611:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790964074.234303:0:32611:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1790964074.234304:0:32611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1790964074.234306:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964074.234307:0:32611:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1790964074.234310:0:32611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1790964074.234314:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1790964074.234315:0:32611:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1790964074.234318:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1790964074.234322:0:32611:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.147@tcp to nid 0x20000c0a8c993 (192.168.201.147@tcp) 00000020:00000080:3.0:1790964074.234342:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1790964074.234352:0:32611:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (0000000081062c31) 00000020:00000080:3.0:1790964074.234366:0:32611:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1790964074.234372:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1790964074.234445:0:32611:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1790964074.234451:0:32611:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1790964074.234457:0:32611:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x6a601b0c127d510c 00010000:00080000:3.0:1790964074.234526:0:32611:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d0c8ccf1@lustre-MDT0001-osp-MDT0000: add connection 192.168.201.147@tcp at head 00010000:00010000:3.0:1790964074.237245:0:32611:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-2 is initialized 00000020:00000080:2.0:1790964074.238435:0:32611:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1790964074.238451:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1790964074.238516:0:32611:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1790964074.238539:0:32611:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x6a601b0c127d5113 00000100:00080000:2.0:1790964074.238551:0:32611:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1790964074.238556:0:32611:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000d0c8ccf1 using connection 192.168.201.147@tcp/0@lo 00000100:00100000:2.0:1790964074.238591:0:32611:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000002fc40658 x1877961927034240/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1790964074.238615:0:32611:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:2.0:1790964074.238664:0:32611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790964074.238668:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790964074.238670:0:32611:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1790964074.238673:0:32611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1790964074.238678:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790964074.238679:0:32611:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:2.0:1790964074.238682:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1790964074.238684:0:32611:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 00000100:00100000:2.0:1790964074.238716:0:32611:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002b41d4c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32611:1877961927034368:0@lo:502: 00000100:00100000:0.0:1790964074.239004:0:31726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002fc40658 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31726:1877961927034240:0@lo:38: 00000100:00100000:0.0:1790964074.239052:0:31726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1790964074.239130:0:32595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927034240 00000100:00100000:0.0:1790964074.239137:0:32595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927034240 00000100:00100000:0.0:1790964074.239172:0:32595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1790964074.239179:0:32595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbc3ad18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:31726:x1877961927034240:12345-0@lo:38: 00010000:00020000:0.0:1790964074.239193:0:32595:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1790964074.239232:0:32595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbc3ad18 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:31726:x1877961927034240:12345-0@lo:38: Request processed in 52us (180us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790964074.239240:0:32595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1790964074.239276:0:31726:0:(import.c:65:import_set_state_nolock()) 00000000d0c8ccf1 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790964074.239288:0:31726:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1790964074.239291:0:31726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002fc40658 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31726:1877961927034240:0@lo:38: 00000100:00100000:2.0:1790964074.239514:0:32611:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964074.239536:0:32611:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e9ba1948 going to sleep for 11 seconds 00000100:00100000:0.0:1790964074.239735:0:32583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927034368 00000100:00100000:0.0:1790964074.239740:0:32583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927034368 00000100:00100000:0.0:1790964074.239823:0:32583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1790964074.239832:0:32583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ac31bad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+9:32611:x1877961927034368:12345-0@lo:502: 00000100:00100000:0.0:1790964074.240328:0:32583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ac31bad pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+9:32611:x1877961927034368:12345-0@lo:502: Request processed in 497us (1520us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964074.240336:0:32583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1790964074.240412:0:32611:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002b41d4c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32611:1877961927034368:0@lo:502: 00000020:01000000:2.0:1790964074.240444:0:32611:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1790964074.240451:0:32611:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1790964074.240452:0:32611:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:2.0:1790964074.240458:0:32611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1790964074.240975:0:32572:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-33 (rc=0) 10000000:01000000:3.0:1790964074.240996:0:32572:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.147@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1790964074.241026:0:32572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.147@tcp lock: 00000000b5959221/0x6a601b0c127d509c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6a601b0c127d50a3 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964074.241050:0:32572:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.147@tcp lock: 00000000b5959221/0x6a601b0c127d509c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x6a601b0c127d50a3 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790964074.241210:0:32572:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97ef487e6000 from 1 10000000:01000000:3.0:1790964074.241215:0:32572:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1790964074.241254:0:32572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.147@tcp lock: 00000000533fa25b/0x6a601b0c127d511a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964074.241262:0:32572:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.147@tcp lock: 00000000533fa25b/0x6a601b0c127d511a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964074.241271:0:32572:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.147@tcp lock: 00000000533fa25b/0x6a601b0c127d511a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790964074.241289:0:32572:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000026225f91 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927034496:0@lo:101: 00000100:00100000:3.0:1790964074.241331:0:32572:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964074.241369:0:32572:0:(client.c:2716:ptlrpc_set_wait()) set 000000001e0ff566 going to sleep for 11 seconds 00000100:00100000:2.0:1790964074.241430:0:32584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927034496 00000100:00100000:2.0:1790964074.241444:0:32584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927034496 00000100:00100000:2.0:1790964074.241510:0:32584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1790964074.241518:0:32584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005085d34b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+9:32572:x1877961927034496:12345-0@lo:101: 00010000:00010000:2.0:1790964074.241530:0:32584:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1790964074.241545:0:32584:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003133b4d4/0x6a601b0c127d5121 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a601b0c127d511a expref: -99 pid: 32584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964074.241567:0:32584:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003133b4d4/0x6a601b0c127d5121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6a601b0c127d511a expref: 10 pid: 32584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964074.241576:0:32584:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003133b4d4/0x6a601b0c127d5121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6a601b0c127d511a expref: 10 pid: 32584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964074.241584:0:32584:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003133b4d4, rc 0) 00000100:00100000:2.0:1790964074.241625:0:32584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005085d34b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+10:32572:x1877961927034496:12345-0@lo:101: Request processed in 108us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964074.241631:0:32584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1790964074.241746:0:32572:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000026225f91 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927034496:0@lo:101: 00010000:00010000:1.0:1790964074.241759:0:32572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.147@tcp lock: 00000000533fa25b/0x6a601b0c127d511a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6a601b0c127d5121 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964074.241768:0:32572:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.147@tcp lock: 00000000533fa25b/0x6a601b0c127d511a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6a601b0c127d5121 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964074.243793:0:32572:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b2d37c3a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927034624:0@lo:256: 00000100:00100000:1.0:1790964074.244139:0:32572:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964074.244176:0:32572:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c72458af going to sleep for 11 seconds 00000100:00100000:3.0:1790964074.244296:0:32585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927034624 00000100:00100000:3.0:1790964074.244303:0:32585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927034624 00000100:00100000:3.0:1790964074.244337:0:32585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1790964074.244346:0:32585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004aca5682 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+10:32572:x1877961927034624:12345-0@lo:256: 20000000:01000000:3.0:1790964074.244365:0:32585:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1790964074.244371:0:32585:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1790964074.244450:0:32585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004aca5682 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+10:32572:x1877961927034624:12345-0@lo:256: Request processed in 105us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964074.244458:0:32585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1790964074.244691:0:32572:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b2d37c3a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927034624:0@lo:256: 10000000:01000000:1.0:1790964074.245450:0:32572:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1790964074.245582:0:32572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.147@tcp lock: 00000000533fa25b/0x6a601b0c127d511a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6a601b0c127d5121 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964074.245594:0:32572:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.147@tcp lock: 00000000533fa25b/0x6a601b0c127d511a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6a601b0c127d5121 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1790964074.245602:0:32572:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff97ef487e6000 from 1 10000000:01000000:1.0:1790964074.245605:0:32572:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1790964074.245643:0:32572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.147@tcp lock: 000000008a11cd0d/0x6a601b0c127d5128 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964074.245651:0:32572:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.147@tcp lock: 000000008a11cd0d/0x6a601b0c127d5128 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964074.245660:0:32572:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.147@tcp lock: 000000008a11cd0d/0x6a601b0c127d5128 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964074.245679:0:32572:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b2d37c3a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927034752:0@lo:101: 00000100:00100000:1.0:1790964074.245727:0:32572:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964074.245759:0:32572:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c72458af going to sleep for 11 seconds 00000100:00100000:3.0:1790964074.245833:0:32585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927034752 00000100:00100000:3.0:1790964074.245840:0:32585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927034752 00000100:00100000:3.0:1790964074.245905:0:32585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1790964074.245913:0:32585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000eeaec4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+10:32572:x1877961927034752:12345-0@lo:101: 00010000:00010000:3.0:1790964074.245925:0:32585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1790964074.245940:0:32585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000451e4d25/0x6a601b0c127d512f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a601b0c127d5128 expref: -99 pid: 32585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964074.245963:0:32585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000451e4d25/0x6a601b0c127d512f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6a601b0c127d5128 expref: 11 pid: 32585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964074.245973:0:32585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000451e4d25/0x6a601b0c127d512f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6a601b0c127d5128 expref: 11 pid: 32585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964074.245982:0:32585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000451e4d25, rc 0) 00000100:00100000:3.0:1790964074.246025:0:32585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000eeaec4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+11:32572:x1877961927034752:12345-0@lo:101: Request processed in 102us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964074.246032:0:32585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1790964074.246408:0:32572:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b2d37c3a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927034752:0@lo:101: 00010000:00010000:1.0:1790964074.246425:0:32572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.147@tcp lock: 000000008a11cd0d/0x6a601b0c127d5128 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6a601b0c127d512f expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964074.246440:0:32572:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.147@tcp lock: 000000008a11cd0d/0x6a601b0c127d5128 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6a601b0c127d512f expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964074.246535:0:32572:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b2d37c3a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927034880:0@lo:501: 00000100:00100000:1.0:1790964074.246564:0:32572:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964074.246583:0:32572:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c72458af going to sleep for 11 seconds 00000100:00100000:3.0:1790964074.246664:0:32585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927034880 00000100:00100000:3.0:1790964074.246670:0:32585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927034880 00000100:00100000:3.0:1790964074.246702:0:32585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1790964074.246708:0:32585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004df60114 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+11:32572:x1877961927034880:12345-0@lo:501: 00000100:00100000:3.0:1790964074.247299:0:32585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004df60114 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+11:32572:x1877961927034880:12345-0@lo:501: Request processed in 591us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964074.247307:0:32585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1790964074.247372:0:32572:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b2d37c3a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927034880:0@lo:501: 00000100:00100000:1.0:1790964074.247400:0:32572:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b2d37c3a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927035008:0@lo:503: 00000100:00100000:1.0:1790964074.247434:0:32572:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964074.247456:0:32572:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c72458af going to sleep for 11 seconds 00000100:00100000:3.0:1790964074.247512:0:32584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927035008 00000100:00100000:3.0:1790964074.247516:0:32584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927035008 00000100:00100000:3.0:1790964074.247546:0:32584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1790964074.247552:0:32584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033493fb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+11:32572:x1877961927035008:12345-0@lo:503: 00000040:00080000:3.0:1790964074.247585:0:32584:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1790964074.247623:0:32584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033493fb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+11:32572:x1877961927035008:12345-0@lo:503: Request processed in 72us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964074.247629:0:32584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1790964074.247737:0:32572:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b2d37c3a pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927035008:0@lo:503: 00000040:00080000:1.0:1790964074.248791:0:32619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1790964074.249586:0:32572:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1790964074.249608:0:32572:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.147@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1790964074.249623:0:32572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.147@tcp lock: 000000008a11cd0d/0x6a601b0c127d5128 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6a601b0c127d512f expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964074.249635:0:32572:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.147@tcp lock: 000000008a11cd0d/0x6a601b0c127d5128 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6a601b0c127d512f expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1790964074.249688:0:32572:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1790964074.249691:0:32572:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff97ef487e6000 10000000:01000000:3.0:1790964074.249693:0:32572:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff97ef487e6000 10000000:01000000:3.0:1790964074.249697:0:32572:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1790964074.249702:0:32572:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff97ef487e6000 from 1 10000000:01000000:3.0:1790964074.249704:0:32572:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1790964074.249733:0:32572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.147@tcp lock: 00000000ee8a4c2d/0x6a601b0c127d5136 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964074.249738:0:32572:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.147@tcp lock: 00000000ee8a4c2d/0x6a601b0c127d5136 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964074.249744:0:32572:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.147@tcp lock: 00000000ee8a4c2d/0x6a601b0c127d5136 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790964074.249760:0:32572:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004af196b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927035136:0@lo:101: 00000100:00100000:3.0:1790964074.249804:0:32572:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964074.249838:0:32572:0:(client.c:2716:ptlrpc_set_wait()) set 000000003fd2f2eb going to sleep for 11 seconds 00000100:00100000:1.0:1790964074.249893:0:32585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927035136 00000100:00100000:1.0:1790964074.249900:0:32585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927035136 00000100:00100000:1.0:1790964074.249944:0:32585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1790964074.249952:0:32585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e65d92fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+11:32572:x1877961927035136:12345-0@lo:101: 00010000:00010000:1.0:1790964074.249964:0:32585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1790964074.249975:0:32585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000082a84454/0x6a601b0c127d513d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a601b0c127d5136 expref: -99 pid: 32585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964074.249998:0:32585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000082a84454/0x6a601b0c127d513d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6a601b0c127d5136 expref: 12 pid: 32585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964074.250007:0:32585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000082a84454/0x6a601b0c127d513d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6a601b0c127d5136 expref: 12 pid: 32585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964074.250166:0:32585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000082a84454, rc 0) 00000100:00100000:1.0:1790964074.250211:0:32585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e65d92fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+12:32572:x1877961927035136:12345-0@lo:101: Request processed in 260us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964074.250218:0:32585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1790964074.250254:0:32572:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004af196b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927035136:0@lo:101: 00010000:00010000:3.0:1790964074.250274:0:32572:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.147@tcp lock: 00000000ee8a4c2d/0x6a601b0c127d5136 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6a601b0c127d513d expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964074.250280:0:32572:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.147@tcp lock: 00000000ee8a4c2d/0x6a601b0c127d5136 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x6a601b0c127d513d expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790964074.250315:0:32572:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004af196b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927035264:0@lo:501: 00000100:00100000:3.0:1790964074.250333:0:32572:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964074.250349:0:32572:0:(client.c:2716:ptlrpc_set_wait()) set 000000003fd2f2eb going to sleep for 11 seconds 00000100:00100000:0.0:1790964074.250384:0:32583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927035264 00000100:00100000:0.0:1790964074.250389:0:32583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927035264 00000100:00100000:0.0:1790964074.250422:0:32583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1790964074.250434:0:32583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5ace331 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+12:32572:x1877961927035264:12345-0@lo:501: 00000100:00100000:0.0:1790964074.250714:0:32583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5ace331 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+12:32572:x1877961927035264:12345-0@lo:501: Request processed in 280us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964074.250722:0:32583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1790964074.250756:0:32572:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004af196b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927035264:0@lo:501: 00000100:00100000:3.0:1790964074.250785:0:32572:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004af196b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927035392:0@lo:503: 00000100:00100000:3.0:1790964074.250823:0:32572:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964074.250852:0:32572:0:(client.c:2716:ptlrpc_set_wait()) set 000000003fd2f2eb going to sleep for 11 seconds 00000100:00100000:1.0:1790964074.250899:0:32585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927035392 00000100:00100000:1.0:1790964074.250904:0:32585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927035392 00000100:00100000:1.0:1790964074.250934:0:32585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1790964074.250940:0:32585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006be52972 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+12:32572:x1877961927035392:12345-0@lo:503: 00000100:00100000:1.0:1790964074.251074:0:32585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006be52972 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+12:32572:x1877961927035392:12345-0@lo:503: Request processed in 135us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964074.251081:0:32585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1790964074.251148:0:32572:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004af196b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927035392:0@lo:503: 00000100:00100000:1.0:1790964074.257433:0:32620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b2d37c3a pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32620:1877961927035520:0@lo:502: 00000100:00100000:1.0:1790964074.257568:0:32620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964074.257623:0:32620:0:(client.c:2716:ptlrpc_set_wait()) set 0000000086468772 going to sleep for 11 seconds 00000100:00100000:0.0:1790964074.257754:0:32583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927035520 00000100:00100000:0.0:1790964074.257761:0:32583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927035520 00000100:00100000:0.0:1790964074.257819:0:32583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1790964074.257828:0:32583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009868b72f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+12:32620:x1877961927035520:12345-0@lo:502: 00000100:00100000:0.0:1790964074.258155:0:32583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009868b72f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+12:32620:x1877961927035520:12345-0@lo:502: Request processed in 327us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964074.258163:0:32583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1790964074.261657:0:32620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b2d37c3a pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32620:1877961927035520:0@lo:502: 00000020:01000004:3.0:1790964074.261777:0:32620:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1790964074.261794:0:32620:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (0000000017f1a752) 00000020:00000080:3.0:1790964074.261816:0:32620:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1790964074.261925:0:32620:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000010e558e2 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790964074.261929:0:32620:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000010e558e2 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1790964074.261932:0:32620:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000010e558e2 4 00010000:00080000:3.0:1790964074.261961:0:32620:0:(ldlm_lib.c:102:import_set_conn()) imp 000000007c9fe86f@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.147@tcp at head 00010000:00010000:3.0:1790964074.265615:0:32620:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1790964074.265812:0:32620:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1790964074.265849:0:32620:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1790964074.265865:0:32620:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x6a601b0c127d514b 00000100:00080000:3.0:1790964074.265877:0:32620:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1790964074.265882:0:32620:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000007c9fe86f using connection 192.168.201.147@tcp/0@lo 00000100:00100000:3.0:1790964074.265929:0:32620:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000007aaf93a x1877961927035648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1790964074.265956:0:32620:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1790964074.266183:0:31726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000007aaf93a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31726:1877961927035648:0@lo:38: 00000100:00100000:2.0:1790964074.266263:0:31726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964074.266397:0:32620:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000027c66538 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32620:1877961927035776:0@lo:502: 00000100:00100000:2.0:1790964074.266439:0:32620:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1790964074.266465:0:32584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927035776 00000100:00100000:2.0:1790964074.266472:0:32584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927035776 00000100:00100000:2.0:1790964074.266533:0:32584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790964074.266541:0:32584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019b72ec8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+12:32620:x1877961927035776:12345-0@lo:502: 00000100:00100000:2.0:1790964074.267001:0:32584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019b72ec8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+12:32620:x1877961927035776:12345-0@lo:502: Request processed in 460us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964074.267014:0:32584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1790964074.267104:0:32620:0:(client.c:2716:ptlrpc_set_wait()) set 00000000a68f747b going to sleep for 11 seconds 00000100:00100000:2.0:1790964074.267124:0:32620:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000027c66538 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32620:1877961927035776:0@lo:502: 00000040:00080000:2.0:1790964074.267152:0:32620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000100:00100000:3.0:1790964074.267938:0:32589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927035648 00000100:00100000:3.0:1790964074.267947:0:32589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927035648 00000100:00100000:3.0:1790964074.267979:0:32589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790964074.267984:0:32589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b41d4c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:31726:x1877961927035648:12345-0@lo:38: 00000100:00100000:3.0:1790964074.268049:0:32589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b41d4c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:31726:x1877961927035648:12345-0@lo:38: Request processed in 64us (1787us total) trans 0 rc -11/-11 00000100:00100000:3.0:1790964074.268056:0:32589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000020:01000000:3.0:1790964074.268079:0:32572:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1790964074.268101:0:32572:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.147@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1790964074.268114:0:32572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.147@tcp lock: 00000000ee8a4c2d/0x6a601b0c127d5136 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6a601b0c127d513d expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964074.268124:0:32572:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.147@tcp lock: 00000000ee8a4c2d/0x6a601b0c127d5136 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x6a601b0c127d513d expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1790964074.268182:0:32572:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1790964074.268185:0:32572:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790964074.268186:0:32572:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790964074.268187:0:32572:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790964074.268188:0:32572:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790964074.268189:0:32572:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790964074.268191:0:32572:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790964074.268192:0:32572:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790964074.268193:0:32572:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790964074.268195:0:32572:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790964074.268199:0:32572:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1790964074.268202:0:32572:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1790964074.268203:0:32572:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790964074.268204:0:32572:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790964074.268209:0:32572:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790964074.268210:0:32572:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790964074.268210:0:32572:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790964074.268211:0:32572:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790964074.268212:0:32572:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790964074.268213:0:32572:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790964074.268214:0:32572:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1790964074.268230:0:32572:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1790964074.268242:0:32572:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009592a7ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927035904:0@lo:253: 00000100:00100000:3.0:1790964074.268275:0:32572:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964074.268305:0:32572:0:(client.c:2716:ptlrpc_set_wait()) set 00000000abf11528 going to sleep for 11 seconds 00000100:00100000:0.0:1790964074.268311:0:32585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927035904 00000100:00100000:0.0:1790964074.268315:0:32585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927035904 00000100:00100000:0.0:1790964074.268353:0:32585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1790964074.268359:0:32585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e545412f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+12:32572:x1877961927035904:12345-0@lo:253: 20000000:01000000:0.0:1790964074.268381:0:32585:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1790964074.268392:0:32585:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1790964074.268400:0:31726:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1790964074.268407:0:31726:0:(import.c:65:import_set_state_nolock()) 000000007c9fe86f lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1790964074.268411:0:31726:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1790964074.268414:0:31726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000007aaf93a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31726:1877961927035648:0@lo:38: 20000000:01000000:2.0:1790964074.293262:0:32585:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1790964074.293283:0:32585:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1790964074.293348:0:32606:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1790964074.293354:0:32606:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1790964074.293376:0:32606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000065206fdc/0x6a601b0c127d5152 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 32606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964074.293396:0:32606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003133b4d4/0x6a601b0c127d5121 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6a601b0c127d511a expref: 12 pid: 32584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964074.293405:0:32606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000065206fdc/0x6a601b0c127d5152 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 32606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964074.293446:0:32606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003133b4d4/0x6a601b0c127d5121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x6a601b0c127d511a expref: 12 pid: 32584 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964074.293461:0:32606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003133b4d4/0x6a601b0c127d5121 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x6a601b0c127d511a expref: 12 pid: 32584 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1790964074.293505:0:32606:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000b260565a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:32606:1877961927036032:0@lo:104: 00000100:00100000:3.0:1790964074.293575:0:32606:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1790964074.293623:0:32606:0:(client.c:2716:ptlrpc_set_wait()) set 000000002baccce1 going to sleep for 11 seconds 00000100:00100000:1.0:1790964074.293624:0:32573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927036032 00000100:00100000:1.0:1790964074.293633:0:32573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927036032 00000100:00100000:1.0:1790964074.293682:0:32573:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790964074.293690:0:32573:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f2c98f7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+3:32606:x1877961927036032:12345-0@lo:104: 00010000:00010000:1.0:1790964074.293704:0:32573:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.147@tcp lock: 00000000533fa25b/0x6a601b0c127d511a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6a601b0c127d5121 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964074.294921:0:32573:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1790964074.294932:0:32573:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f2c98f7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+3:32606:x1877961927036032:12345-0@lo:104: Request processed in 1242us (1355us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964074.294940:0:32573:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1790964074.294943:0:32606:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000b260565a pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:32606:1877961927036032:0@lo:104: 00010000:00010000:3.0:1790964074.294963:0:32606:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000065206fdc/0x6a601b0c127d5152 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 32606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964074.295151:0:32578:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1790964074.295157:0:32578:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.147@tcp lock: 00000000533fa25b/0x6a601b0c127d511a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x6a601b0c127d5121 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964074.295163:0:32578:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000533fa25b already unused, calling callback (00000000cfaf3780) 10000000:00010000:2.0:1790964074.295165:0:32578:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.147@tcp lock: 00000000533fa25b/0x6a601b0c127d511a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x6a601b0c127d5121 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964074.295172:0:32578:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.147@tcp lock: 00000000533fa25b/0x6a601b0c127d511a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x6a601b0c127d5121 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1790964074.295176:0:32578:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.147@tcp lock: 00000000533fa25b/0x6a601b0c127d511a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x6a601b0c127d5121 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1790964074.295180:0:32578:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1790964074.295219:0:32578:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.147@tcp lock: 00000000533fa25b/0x6a601b0c127d511a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6a601b0c127d5121 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964074.295237:0:32578:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1790964074.295264:0:32578:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.147@tcp lock: 00000000533fa25b/0x6a601b0c127d511a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6a601b0c127d5121 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964074.295271:0:32578:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.147@tcp lock: 00000000533fa25b/0x6a601b0c127d511a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x6a601b0c127d5121 expref: -99 pid: 32572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1790964074.295287:0:32578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790964074.295289:0:32578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1790964074.295290:0:32578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1790964074.295364:0:31728:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000027c66538 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:31728:1877961927036160:0@lo:103: 00000100:00100000:3.0:1790964074.295421:0:31728:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1790964074.295471:0:32575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927036160 00000100:00100000:1.0:1790964074.295522:0:32575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927036160 00010000:00010000:1.0:1790964074.295546:0:32575:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003133b4d4/0x6a601b0c127d5121 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6a601b0c127d511a expref: 13 pid: 32584 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964074.295574:0:32575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790964074.295582:0:32575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b260565a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+13:31728:x1877961927036160:12345-0@lo:103: 00010000:00010000:1.0:1790964074.295595:0:32575:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1790964074.295599:0:32575:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003133b4d4/0x6a601b0c127d5121 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x6a601b0c127d511a expref: 13 pid: 32584 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964074.295609:0:32575:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003133b4d4/0x6a601b0c127d5121 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x6a601b0c127d511a expref: 13 pid: 32584 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964074.295622:0:32575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003133b4d4/0x6a601b0c127d5121 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x6a601b0c127d511a expref: 13 pid: 32584 timeout: 1086 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964074.295635:0:32575:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000065206fdc/0x6a601b0c127d5152 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 32606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964074.295644:0:32575:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000065206fdc/0x6a601b0c127d5152 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 32606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1790964074.295657:0:32575:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002304134s 00010000:00010000:1.0:1790964074.295659:0:32575:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000065206fdc/0x6a601b0c127d5152 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 32606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964074.295664:0:32575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000065206fdc/0x6a601b0c127d5152 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 32606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964074.295669:0:32575:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000065206fdc/0x6a601b0c127d5152 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 32606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964074.295679:0:32575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000065206fdc/0x6a601b0c127d5152 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 32606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964074.295683:0:32575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000065206fdc already unused, calling callback (000000001391cba8) 00010000:00010000:1.0:1790964074.295685:0:32575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000065206fdc/0x6a601b0c127d5152 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 32606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964074.295690:0:32575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000065206fdc/0x6a601b0c127d5152 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 32606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964074.295702:0:32575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000065206fdc/0x6a601b0c127d5152 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1790964074.295712:0:32575:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1790964074.295717:0:32606:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000065206fdc/0x6a601b0c127d5152 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964074.295724:0:32606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000065206fdc/0x6a601b0c127d5152 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964074.295730:0:32606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000065206fdc/0x6a601b0c127d5152 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 32606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1790964074.295743:0:32575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b260565a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+12:31728:x1877961927036160:12345-0@lo:103: Request processed in 163us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964074.295751:0:32575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1790964074.295775:0:31728:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000027c66538 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:31728:1877961927036160:0@lo:103: 00000100:00100000:0.0:1790964074.303237:0:32585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e545412f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+11:32572:x1877961927035904:12345-0@lo:253: Request processed in 34868us (34951us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964074.303253:0:32585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1790964074.303259:0:32572:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009592a7ec pname:cluuid:pid:xid:nid:opc:job mount.lustre:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32572:1877961927035904:0@lo:253: 10000000:01000000:3.0:1790964074.303274:0:32572:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1790964074.303277:0:32572:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1790964074.303279:0:32572:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1790964074.303281:0:32572:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1790964074.303282:0:32572:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1790964074.303284:0:32572:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1790964074.303285:0:32572:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1790964074.303286:0:32572:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1790964074.303287:0:32572:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1790964074.303289:0:32572:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1790964074.303290:0:32572:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1790964074.303305:0:32572:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1790964074.306894:0:32572:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1790964074.307158:0:32572:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1790964074.307348:0:32572:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1790964074.307591:0:32572:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1790964074.307800:0:32572:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1790964074.307918:0:32572:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1790964074.308542:0:32572:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1790964074.308657:0:32572:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1790964074.313291:0:32572:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1790964074.313465:0:32572:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1790964074.313737:0:32572:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1790964074.313835:0:32572:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000040:01000000:0.0:1790964074.367221:0:32572:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000004:02000000:0.0:1790964074.367236:0:32572:0:(lod_dev.c:733:lod_sub_init_llog()) *** cfs_fail_loc=2405, val=0*** 00000020:00080000:3.0:1790964074.367342:0:32626:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1790964074.367347:0:32626:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1790964074.371133:0:32627:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1790964074.371398:0:32572:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1790964074.371923:0:32627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1790964074.375891:0:32627:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1790964074.375993:0:32627:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000100:00080000:0.0:1790964074.378652:0:32628:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@0000000004c6e2e8 x1877961927036288/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964074.378669:0:32628:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017495dc3 going to sleep for 0 seconds 00000040:01000000:2.0:1790964074.379181:0:32572:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1790964074.379310:0:32572:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1790964074.383344:0:32572:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1790964074.383469:0:32572:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1790964074.386143:0:32572:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1790964074.387199:0:32572:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1790964074.387771:0:32572:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1790964074.387805:0:32572:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1790964074.388080:0:32572:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1790964074.391913:0:32572:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x37:0x0] (8/8/4) registered 00000001:00000004:3.0:1790964074.404381:0:32572:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:3.0:1790964074.466711:0:32572:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1790964074.466751:0:32572:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffafb543f03988 00100000:10000000:3.0:1790964074.466759:0:32572:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1790964074.467594:0:32572:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1790964074.467607:0:32572:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.147@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1790964074.467622:0:32572:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1790964074.467638:0:32572:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1790964074.932690:0:32579:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790964075.394367:0:32628:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017495dc3 going to sleep for 0 seconds 00010000:00010000:2.0:1790964075.956760:0:32578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1790964076.404535:0:32628:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017495dc3 going to sleep for 0 seconds 00010000:00010000:0.0:1790964076.985257:0:32579:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790964077.431031:0:32628:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017495dc3 going to sleep for 0 seconds 00010000:00010000:1.0:1790964078.005462:0:32578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1790964078.454517:0:32628:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017495dc3 going to sleep for 0 seconds 00000001:02000400:1.0:1790964078.976109:0:32870:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg147-server.virtnet: executing set_default_debug -1 all 00000400:00000001:0.0:1790964079.012813:0:32872:0:(debug.c:305:cfs_str2mask()) Process entered 00010000:00000001:2.0:1790964079.029777:0:31384:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:2.0:1790964079.029786:0:31384:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964079.029792:0:31384:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:2.0:1790964079.029794:0:31384:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964079.033475:0:32579:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:0.0:1790964079.033500:0:32579:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:0.0:1790964079.033505:0:32579:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000001:2.0:1790964079.476682:0:32628:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:2.0:1790964079.476691:0:32628:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964079.476693:0:32628:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964079.476697:0:32628:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017495dc3 going to sleep for 0 seconds 00000100:00000001:2.0:1790964079.476702:0:32628:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964079.476706:0:32628:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964079.476708:0:32628:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1790964079.476710:0:32628:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964079.476713:0:32628:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964079.742613:0:31726:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:2.0:1790964079.742629:0:31726:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964079.742630:0:31726:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964079.742647:0:31726:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964079.742649:0:31726:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964079.742652:0:31726:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964079.742655:0:31726:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964079.745990:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5c322e7-c837-4fbe-89d7-d887ea2ad81f->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:2.0:1790964079.746002:0:8:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:2.0:1790964079.746010:0:8:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 00000000397d6266. 00000020:00000040:2.0:1790964079.746017:0:8:0:(genops.c:1210:class_import_get()) import 00000000f7398c40 refcount=4 obd=MGC192.168.201.147@tcp 00000100:00000001:2.0:1790964079.746021:0:8:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1790964079.746024:0:8:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1790964079.746029:0:8:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1790964079.746036:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d58888bf. 00000100:00000001:2.0:1790964079.746043:0:8:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964079.746053:0:8:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging e5c322e7-c837-4fbe-89d7-d887ea2ad81f->MGS req@00000000397d6266 x1877961927036416/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:2.0:1790964079.746327:0:8:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1790964079.746330:0:8:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964079.746337:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000397d6266] to pc [ptlrpcd_00_02+2] req@00000000397d6266 x1877961927036416/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964079.746366:0:8:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00080000:2.0:1790964079.746370:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790964079.746374:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00000001:2.0:1790964079.746376:0:8:0:(import.c:745:ptlrpc_connect_import_locked()) Process entered 00000100:00080000:2.0:1790964079.746378:0:8:0:(import.c:65:import_set_state_nolock()) 000000007c9fe86f lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000001:2.0:1790964079.746840:0:8:0:(import.c:520:import_select_connection()) Process entered 00000100:00000040:2.0:1790964079.746843:0:8:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000ae02bb19 refcount 13 to 0@lo 00000100:00000001:2.0:1790964079.746846:0:8:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:2.0:1790964079.746848:0:8:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000ae02bb19 refcount 14 to 0@lo 00000100:00000001:2.0:1790964079.746850:0:8:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446629656951528384 : -114416758023232 : ffff97f045c81bc0) 00000020:00000001:2.0:1790964079.746854:0:8:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:2.0:1790964079.746855:0:8:0:(genops.c:804:class_conn2export()) looking for export cookie 0x6a601b0c127d514b 00000020:00000001:2.0:1790964079.746858:0:8:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:2.0:1790964079.746941:0:8:0:(lustre_handles.c:148:class_handle2object()) GET export 000000008051da39 refcount=7 00000020:00000001:2.0:1790964079.746943:0:8:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446629656913846272 : -114416795705344 : ffff97f043892000) 00000020:00000001:2.0:1790964079.746946:0:8:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446629656913846272 : -114416795705344 : ffff97f043892000) 00000100:00000040:2.0:1790964079.746949:0:8:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000ae02bb19 refcount 13 to 0@lo 00000100:00000001:2.0:1790964079.746951:0:8:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:2.0:1790964079.746952:0:8:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000ae02bb19 refcount 14 to 0@lo 00000100:00000001:2.0:1790964079.746954:0:8:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446629656951528384 : -114416758023232 : ffff97f045c81bc0) 00000020:00000040:2.0:1790964079.746957:0:8:0:(genops.c:879:class_export_put()) PUTting export 000000008051da39 : new refcount 6 00000100:00080000:2.0:1790964079.746960:0:8:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 000000007c9fe86f using connection 192.168.201.147@tcp/0@lo 00000100:00000001:2.0:1790964079.746962:0:8:0:(import.c:672:import_select_connection()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964079.746964:0:8:0:(sec.c:1579:sptlrpc_import_sec_adapt()) Process entered 02000000:00000001:2.0:1790964079.746971:0:8:0:(sec.c:1619:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1790964079.746983:0:8:0:(sec.c:1647:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964079.746985:0:8:0:(obd_class.h:888:obd_reconnect()) Process entered 00000100:00000001:2.0:1790964079.746987:0:8:0:(obd_class.h:895:obd_reconnect()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:2.0:1790964079.746991:0:8:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 0000000016edf9f6. 00000020:00000040:2.0:1790964079.746994:0:8:0:(genops.c:1210:class_import_get()) import 000000007c9fe86f refcount=3 obd=lustre-MDT0000-lwp-MDT0000 02000000:00000001:2.0:1790964079.746998:0:8:0:(sec.c:2038:sptlrpc_sepol_get()) Process entered 02000000:00000001:2.0:1790964079.746999:0:8:0:(sec.c:2048:sptlrpc_sepol_get()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964079.747002:0:8:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1790964079.747004:0:8:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1790964079.747007:0:8:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1790964079.747012:0:8:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at 00000000a1f03811. 00000100:00000001:2.0:1790964079.747016:0:8:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964079.747022:0:8:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000016edf9f6 x1877961927036544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:2.0:1790964079.747030:0:8:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1790964079.747032:0:8:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964079.747035:0:8:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000016edf9f6] to pc [ptlrpcd_rcv+-1] req@0000000016edf9f6 x1877961927036544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964079.747047:0:8:0:(import.c:877:ptlrpc_connect_import_locked()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964079.747052:0:8:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (946) 00000100:00000001:3.0:1790964079.747146:0:31729:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000020:00000010:3.0:1790964079.747155:0:31729:0:(tgt_main.c:721:tgt_key_init()) slab-alloced 'thread': 1288 at 000000004ca61e0e. 00000020:00000010:3.0:1790964079.747161:0:31729:0:(update_records.c:1179:update_key_init()) kmalloced '(value)': 432 at 0000000044f6de1f. 80000000:00000010:3.0:1790964079.747165:0:31729:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at 00000000b3c4bc20. 40000000:00000010:3.0:1790964079.747169:0:31729:0:(fid_handler.c:479:seq_key_init()) kmalloced '(value)': 48 at 00000000eff65a26. 00000008:00000010:3.0:1790964079.747174:0:31729:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2864 at 00000000a9e0246a. 00020000:00000010:3.0:1790964079.747178:0:31729:0:(lov_dev.c:78:lov_key_init()) slab-alloced 'info': 192 at 00000000c9808c5a. 00008000:00000010:3.0:1790964079.747183:0:31729:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at 00000000ee4ce62b. 00100000:00000010:3.0:1790964079.747188:0:31729:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at 000000005b8308bc. 00040000:00000010:3.0:1790964079.747192:0:31729:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at 00000000bb2a8e84. 00040000:00000010:3.0:1790964079.747196:0:31729:0:(qmt_dev.c:349:qmt_key_init()) kmalloced '(value)': 1256 at 00000000ba950301. 00040000:00000010:3.0:1790964079.747199:0:31729:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at 00000000e1efb833. 00080000:00000010:3.0:1790964079.747204:0:31729:0:(osd_handler.c:767:osd_key_init()) kmalloced '(info)': 2000 at 000000002c534c00. 00000004:00000010:3.0:1790964079.747214:0:31729:0:(mdd_device.c:2410:mdd_key_init()) kmalloced '(value)': 1872 at 00000000de4fd910. 00000004:00000010:3.0:1790964079.747219:0:31729:0:(mdt_handler.c:8401:mdt_key_init()) kmalloced '(value)': 2568 at 00000000c5723248. 00000004:00000010:3.0:1790964079.747223:0:31729:0:(lod_dev.c:2369:lod_key_init()) kmalloced '(value)': 1224 at 000000007de59fba. 00002000:00000010:3.0:1790964079.747227:0:31729:0:(ofd_dev.c:3004:ofd_key_init()) kmalloced '(value)': 816 at 0000000027075a24. 00000004:00000010:3.0:1790964079.747231:0:31729:0:(osp_dev.c:1831:osp_key_init()) kmalloced '(value)': 616 at 000000004780f693. 00000080:00000010:3.0:1790964079.747236:0:31729:0:(vvp_dev.c:68:ll_thread_key_init()) slab-alloced 'lti': 168 at 0000000064eeb271. 00000080:00000010:3.0:1790964079.747240:0:31729:0:(vvp_dev.c:119:vvp_thread_key_init()) slab-alloced 'vti': 592 at 000000003747dc6f. 00000008:00000010:3.0:1790964079.747245:0:31729:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at 000000002ef03f90. 00020000:00000010:3.0:1790964079.747248:0:31729:0:(lov_dev.c:117:lov_session_key_init()) slab-alloced 'info': 584 at 000000001eb5d008. 00008000:00000010:3.0:1790964079.747251:0:31729:0:(echo_client.c:438:echo_session_key_init()) slab-alloced 'session': 8 at 000000006e697236. 00000080:00000010:3.0:1790964079.747254:0:31729:0:(vvp_dev.c:94:vvp_session_key_init()) slab-alloced 'session': 240 at 0000000020f81658. 00000100:00000001:3.0:1790964079.747256:0:31729:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964079.747259:0:31729:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1790964079.747263:0:31729:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@00000000397d6266 x1877961927036416/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964079.747270:0:31729:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1790964079.747272:0:31729:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964079.747274:0:31729:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1790964079.747276:0:31729:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1790964079.747279:0:31729:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964079.747281:0:31729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000397d6266 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:31729:1877961927036416:0@lo:400: 00000100:00000001:3.0:1790964079.747284:0:31729:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1790964079.747289:0:31729:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1790964079.747291:0:31729:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964079.747293:0:31729:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1790964079.747296:0:31729:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 0000000086e8aa9e. 02000000:00000001:3.0:1790964079.747298:0:31729:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1790964079.747303:0:31729:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000eae732d3. 00000400:00000010:3.0:1790964079.747311:0:31729:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000009552156f. 00000100:00000200:3.0:1790964079.747318:0:31729:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1877961927036416, portal 25 00000100:00000001:3.0:1790964079.747320:0:31729:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1790964079.747322:0:31729:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446629657336975744 : -114416372575872 : ffff97f05cc19180) 00000100:00000040:3.0:1790964079.747325:0:31729:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@00000000397d6266 x1877961927036416/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964095 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964079.747337:0:31729:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1790964079.747340:0:31729:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000001:2.0:1790964079.747341:0:31726:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000400:00000010:3.0:1790964079.747342:0:31729:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 0000000093a4317c. 00000100:00000001:2.0:1790964079.747343:0:31726:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000200:3.0:1790964079.747345:0:31729:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1877961927036416, offset 0 00000100:00000001:2.0:1790964079.747345:0:31726:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1790964079.747348:0:31726:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@0000000016edf9f6 x1877961927036544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000400:00000200:3.0:1790964079.747350:0:31729:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000100:00000001:2.0:1790964079.747354:0:31726:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1790964079.747355:0:31726:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964079.747356:0:31726:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1790964079.747358:0:31726:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1790964079.747360:0:31726:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964079.747362:0:31726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016edf9f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31726:1877961927036544:0@lo:38: 00000400:00000200:3.0:1790964079.747363:0:31729:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000100:00000001:2.0:1790964079.747365:0:31726:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1790964079.747366:0:31726:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1790964079.747368:0:31726:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964079.747369:0:31726:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 00000400:00000200:3.0:1790964079.747373:0:31729:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 26 MB=0x6abff15900e00 02000000:00000010:2.0:1790964079.747373:0:31726:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000de39ad8d. 02000000:00000001:2.0:1790964079.747375:0:31726:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000200:3.0:1790964079.747378:0:31729:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-0@lo of length 224/224 into md 0x161 [2] + 0 00000400:00000010:2.0:1790964079.747379:0:31726:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 0000000068a21e5b. 00000400:00000010:3.0:1790964079.747395:0:31729:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000ec87914b. 00000400:00000200:3.0:1790964079.747401:0:31729:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 000000007535bfc7 00000400:00000200:3.0:1790964079.747409:0:31729:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1790964079.747413:0:31729:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:3.0:1790964079.747418:0:31729:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000007535bfc7 00000400:00000010:3.0:1790964079.747420:0:31729:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at 000000007535bfc7. 00000100:00000001:3.0:1790964079.747424:0:31729:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:3.0:1790964079.747426:0:31729:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 00000100:00000040:3.0:1790964079.747429:0:31729:0:(events.c:341:request_in_callback()) incoming req@00000000923d726c x1877961927036416 msgsize 224 00000100:00100000:3.0:1790964079.747433:0:31729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1790964079.747435:0:31729:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000001:3.0:1790964079.747445:0:31729:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:3.0:1790964079.747451:0:31729:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 0000000093a4317c 00000400:00000010:3.0:1790964079.747452:0:31729:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 0000000093a4317c. 00000100:00000001:3.0:1790964079.747455:0:31729:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:3.0:1790964079.747458:0:31729:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@00000000397d6266 x1877961927036416/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964095 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964079.747466:0:31729:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964079.747468:0:31729:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@00000000397d6266 x1877961927036416/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964095 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964079.747475:0:31729:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964079.747476:0:31729:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:3.0:1790964079.747499:0:31729:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964079.747504:0:31729:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS new deadline estimation for cpu 0 is 4295608848 00000100:00000010:3.0:1790964079.747508:0:31729:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 000000001af32f20. 00000100:00000001:3.0:1790964079.747520:0:31729:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS request now active for cpu 0 00000100:00000001:3.0:1790964079.747525:0:31729:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS new deadline estimation for cpu 1 is 4295608848 00000100:00000010:3.0:1790964079.747527:0:31729:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 000000007cf71dd4. 00000100:00000001:3.0:1790964079.747530:0:31729:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS request now active for cpu 1 00000100:00000001:3.0:1790964079.747533:0:31729:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS new deadline estimation for cpu 2 is 4295608848 00000100:00000010:3.0:1790964079.747536:0:31729:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 000000005618086a. 00000100:00000001:3.0:1790964079.747539:0:31729:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS request now active for cpu 2 00000100:00000001:3.0:1790964079.747541:0:31729:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS new deadline estimation for cpu 3 is 4295608848 00000100:00000010:3.0:1790964079.747543:0:31729:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000be43824c. 00000100:00000001:3.0:1790964079.747546:0:31729:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS request now active for cpu 3 00000100:00000001:3.0:1790964079.747548:0:31729:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1790964079.747551:0:31729:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964079.747554:0:31729:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964079.747556:0:31729:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964079.747562:0:31729:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964079.747563:0:31729:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:3.0:1790964079.747565:0:31729:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964079.747566:0:31729:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964079.747568:0:31729:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964079.747570:0:31729:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964079.747578:0:31730:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000020:00000010:3.0:1790964079.747582:0:31730:0:(tgt_main.c:721:tgt_key_init()) slab-alloced 'thread': 1288 at 00000000ae0d97ec. 00000020:00000010:3.0:1790964079.747586:0:31730:0:(update_records.c:1179:update_key_init()) kmalloced '(value)': 432 at 0000000069c62a58. 80000000:00000010:3.0:1790964079.747589:0:31730:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at 000000007cf64133. 40000000:00000010:3.0:1790964079.747591:0:31730:0:(fid_handler.c:479:seq_key_init()) kmalloced '(value)': 48 at 000000009d71ed62. 00000008:00000010:3.0:1790964079.747595:0:31730:0:(osc_dev.c:88:osc_key_init()) slab-alloced 'info': 2864 at 0000000093ac8489. 00020000:00000010:3.0:1790964079.747597:0:31730:0:(lov_dev.c:78:lov_key_init()) slab-alloced 'info': 192 at 000000007946fa26. 00008000:00000010:3.0:1790964079.747600:0:31730:0:(echo_client.c:413:echo_thread_key_init()) slab-alloced 'info': 904 at 00000000ed2c7ae1. 00100000:00000010:3.0:1790964079.747603:0:31730:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at 0000000095e5657d. 00040000:00000010:3.0:1790964079.747605:0:31730:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at 00000000370a5ab6. 00040000:00000010:3.0:1790964079.747607:0:31730:0:(qmt_dev.c:349:qmt_key_init()) kmalloced '(value)': 1256 at 00000000ce9f2b5c. 00040000:00000010:3.0:1790964079.747610:0:31730:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at 00000000869bb1ef. 00080000:00000010:3.0:1790964079.747613:0:31730:0:(osd_handler.c:767:osd_key_init()) kmalloced '(info)': 2000 at 0000000045971c78. 00000004:00000010:3.0:1790964079.747622:0:31730:0:(mdd_device.c:2410:mdd_key_init()) kmalloced '(value)': 1872 at 00000000f82ba4de. 00000004:00000010:3.0:1790964079.747625:0:31730:0:(mdt_handler.c:8401:mdt_key_init()) kmalloced '(value)': 2568 at 00000000f9f56409. 00000004:00000010:3.0:1790964079.747628:0:31730:0:(lod_dev.c:2369:lod_key_init()) kmalloced '(value)': 1224 at 00000000314575e1. 00002000:00000010:3.0:1790964079.747630:0:31730:0:(ofd_dev.c:3004:ofd_key_init()) kmalloced '(value)': 816 at 0000000070e1c8d7. 00000004:00000010:3.0:1790964079.747632:0:31730:0:(osp_dev.c:1831:osp_key_init()) kmalloced '(value)': 616 at 00000000394903bd. 00000080:00000010:3.0:1790964079.747635:0:31730:0:(vvp_dev.c:68:ll_thread_key_init()) slab-alloced 'lti': 168 at 00000000d81b7c35. 00000400:00000010:2.0:1790964079.747636:0:31726:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 000000009735db84. 00000080:00000010:3.0:1790964079.747637:0:31730:0:(vvp_dev.c:119:vvp_thread_key_init()) slab-alloced 'vti': 592 at 00000000951c20fa. 00000100:00000200:2.0:1790964079.747639:0:31726:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1877961927036544, portal 10 00000008:00000010:3.0:1790964079.747641:0:31730:0:(osc_dev.c:115:osc_session_init()) slab-alloced 'info': 352 at 0000000031df303a. 00000100:00000001:2.0:1790964079.747641:0:31726:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1790964079.747642:0:31726:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446629657336979328 : -114416372572288 : ffff97f05cc19f80) 00020000:00000010:3.0:1790964079.747643:0:31730:0:(lov_dev.c:117:lov_session_key_init()) slab-alloced 'info': 584 at 000000003d7d9586. 00008000:00000010:3.0:1790964079.747645:0:31730:0:(echo_client.c:438:echo_session_key_init()) slab-alloced 'session': 8 at 000000004e39154c. 00000080:00000010:3.0:1790964079.747648:0:31730:0:(vvp_dev.c:94:vvp_session_key_init()) slab-alloced 'session': 240 at 00000000b920a140. 00000100:00000040:2.0:1790964079.747648:0:31726:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@0000000016edf9f6 x1877961927036544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964089 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964079.747650:0:31730:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964079.747654:0:31726:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1790964079.747656:0:31726:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:2.0:1790964079.747658:0:31726:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000b18255f0. 00000100:00000200:2.0:1790964079.747659:0:31726:0:(niobuf.c:94:ptl_send_buf()) Sending 520 bytes to portal 12, xid 1877961927036544, offset 0 00000400:00000200:2.0:1790964079.747664:0:31726:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:2.0:1790964079.747669:0:31726:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:2.0:1790964079.747674:0:31726:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 520 into portal 12 MB=0x6abff15900e80 00000400:00000200:2.0:1790964079.747678:0:31726:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index c from 12345-0@lo of length 520/520 into md 0x229 [64] + 520 00000400:00000200:2.0:1790964079.747714:0:31726:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1790964079.747717:0:31726:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:2.0:1790964079.748208:0:31726:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:2.0:1790964079.748209:0:31726:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt 00000100:00000010:2.0:1790964079.748214:0:31726:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 00000000edacd42a. 00000100:00000040:2.0:1790964079.748217:0:31726:0:(events.c:341:request_in_callback()) incoming req@00000000edacd42a x1877961927036544 msgsize 520 00000100:00100000:2.0:1790964079.748221:0:31726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000001:2.0:1790964079.748239:0:31726:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:2.0:1790964079.748245:0:31726:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000b18255f0 00000400:00000010:2.0:1790964079.748246:0:31726:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000b18255f0. 00000100:00000001:2.0:1790964079.748249:0:31726:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:2.0:1790964079.748253:0:31726:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@0000000016edf9f6 x1877961927036544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964089 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964079.748259:0:31726:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1790964079.748262:0:31726:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@0000000016edf9f6 x1877961927036544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964089 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964079.748267:0:31726:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964079.748268:0:31726:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:2.0:1790964079.748273:0:31726:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964079.748276:0:31726:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 3063 usecs (4 jiffies) 00000100:00000001:2.0:1790964079.748278:0:31726:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 0 is 4295608849 00000100:00000001:2.0:1790964079.748283:0:31726:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 0, simply extend its deadline from 4295608848 00000100:00000001:2.0:1790964079.748286:0:31726:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 1 is 4295608849 00000100:00000001:2.0:1790964079.748288:0:31726:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 1, simply extend its deadline from 4295608848 00000100:00000001:2.0:1790964079.748290:0:31726:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 2 is 4295608849 00000100:00000001:2.0:1790964079.748292:0:31726:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 2, simply extend its deadline from 4295608848 00000100:00000001:2.0:1790964079.748295:0:31726:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 3 is 4295608849 00000100:00000001:2.0:1790964079.748297:0:31726:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 3, simply extend its deadline from 4295608848 00000100:00000001:2.0:1790964079.748299:0:31726:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1790964079.748301:0:31726:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964079.748304:0:31726:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964079.748305:0:31726:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964079.748310:0:31726:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964079.748317:0:31726:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964079.748319:0:31726:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964079.748320:0:31726:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964079.748322:0:31726:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964079.748323:0:31726:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964079.748361:0:32583:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:2.0:1790964079.748363:0:32583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927036416 02000000:00000001:2.0:1790964079.748365:0:32583:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:2.0:1790964079.748368:0:32583:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1790964079.748370:0:32583:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964079.748375:0:32583:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964079.748378:0:32583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927036416 00000020:00000001:2.0:1790964079.749666:0:32583:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:2.0:1790964079.749668:0:32583:0:(genops.c:804:class_conn2export()) looking for export cookie 0x6a601b0c127d5079 00000020:00000001:2.0:1790964079.749672:0:32583:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:2.0:1790964079.749675:0:32583:0:(lustre_handles.c:148:class_handle2object()) GET export 000000002ab79817 refcount=11 00000020:00000001:2.0:1790964079.749679:0:32583:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446629652579706880 : -114421129844736 : ffff97ef41336800) 00000020:00000001:2.0:1790964079.749682:0:32583:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446629652579706880 : -114421129844736 : ffff97ef41336800) 00000100:00000001:2.0:1790964079.749687:0:32583:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:2.0:1790964079.749692:0:32583:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000575e2000. 00000100:00000001:2.0:1790964079.749695:0:32583:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:2.0:1790964079.749698:0:32583:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000575e2000. 00000020:00000010:2.0:1790964079.749705:0:32583:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000085cd4c9c. 00000020:00000010:2.0:1790964079.749710:0:32583:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 00000000f228a1ea. 00000020:00000010:2.0:1790964079.749715:0:32583:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 0000000054bf6c75. 00000100:00000040:2.0:1790964079.749736:0:32583:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000001:2.0:1790964079.749739:0:32583:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:2.0:1790964079.749741:0:32583:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:2.0:1790964079.749743:0:32583:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964079.749750:0:32583:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964079.749759:0:32583:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964079.749770:0:32583:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:2.0:1790964079.749772:0:32583:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:2.0:1790964079.749776:0:32583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00000040:2.0:1790964079.749780:0:32583:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 000000002ab79817 : new rpc_count 1 00000100:00000001:2.0:1790964079.749782:0:32583:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446629656979056720 : -114416730494896 : ffff97f0476c2850) 00000100:00000040:2.0:1790964079.749798:0:32583:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@00000000923d726c x1877961927036416/t0(0) o400->e5c322e7-c837-4fbe-89d7-d887ea2ad81f@0@lo:655/0 lens 224/0 e 0 to 0 dl 1790964090 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964079.749819:0:32583:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:2.0:1790964079.749821:0:32583:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000575e2000. 00000100:00000001:2.0:1790964079.749823:0:32583:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:2.0:1790964079.749825:0:32583:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000575e2000. 00000100:00100000:2.0:1790964079.749829:0:32583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000923d726c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+11:31729:x1877961927036416:12345-0@lo:400: 00000100:00000200:2.0:1790964079.749832:0:32583:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877961927036416 00000020:00000001:2.0:1790964079.749835:0:32583:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:2.0:1790964079.749839:0:32583:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:2.0:1790964079.749841:0:32583:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964079.749844:0:32583:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:2.0:1790964079.749845:0:32583:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072667842752 : -1041708864 : ffffffffc1e8c8c0) 00000020:00000001:2.0:1790964079.749848:0:32583:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:2.0:1790964079.749850:0:32583:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:2.0:1790964079.749852:0:32583:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:2.0:1790964079.749854:0:32583:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:2.0:1790964079.749858:0:32583:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964079.749860:0:32583:0:(tgt_handler.c:1160:tgt_obd_ping()) Process entered 00000100:00000001:2.0:1790964079.749863:0:32583:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:2.0:1790964079.749865:0:32583:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:2.0:1790964079.749878:0:32583:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 520 at 00000000234964a7. 02000000:00000001:2.0:1790964079.749881:0:32583:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964079.749883:0:32583:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964079.749885:0:32583:0:(tgt_handler.c:1181:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:2.0:1790964079.749887:0:32583:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877961927036416 00010000:00000001:2.0:1790964079.749890:0:32583:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:2.0:1790964079.749893:0:32583:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@00000000923d726c x1877961927036416/t0(0) o400->e5c322e7-c837-4fbe-89d7-d887ea2ad81f@0@lo:655/0 lens 224/224 e 0 to 0 dl 1790964090 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1790964079.749900:0:32583:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:2.0:1790964079.749901:0:32583:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1790964079.749905:0:32583:0:(import.c:2195:obd_at_measure()) add 1 to 0000000015821819 time=6 v=5 (1 0 0 0) 00000100:00000001:2.0:1790964079.749909:0:32583:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:2.0:1790964079.749917:0:32583:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000ae02bb19 refcount 15 to 0@lo 00000100:00000001:2.0:1790964079.749919:0:32583:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446629656951528384 : -114416758023232 : ffff97f045c81bc0) 02000000:00000001:2.0:1790964079.749922:0:32583:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:2.0:1790964079.749924:0:32583:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964079.749927:0:32583:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1790964079.749929:0:32583:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:2.0:1790964079.749933:0:32583:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000b18255f0. 00000100:00000200:2.0:1790964079.749938:0:32583:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 25, xid 1877961927036416, offset 224 00000400:00000200:2.0:1790964079.749944:0:32583:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:2.0:1790964079.749957:0:32583:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:2.0:1790964079.749966:0:32583:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 25 MB=0x6abff15900e00 00000400:00000200:2.0:1790964079.749972:0:32583:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-0@lo of length 224/224 into md 0xaa9 [1] + 224 00000400:00000200:2.0:1790964079.749979:0:32583:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1790964079.749983:0:32583:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:2.0:1790964079.749988:0:32583:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:2.0:1790964079.749992:0:32583:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@00000000397d6266 x1877961927036416/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964095 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1790964079.750001:0:32583:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@00000000397d6266 x1877961927036416/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964095 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964079.750013:0:32583:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:2.0:1790964079.750018:0:32583:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000b18255f0 00000400:00000010:2.0:1790964079.750020:0:32583:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000b18255f0. 00000100:00000001:2.0:1790964079.750022:0:32583:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:2.0:1790964079.750024:0:32583:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:2.0:1790964079.750027:0:32583:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964079.750030:0:32583:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000ae02bb19 refcount 14 to 0@lo 00010000:00000001:2.0:1790964079.750032:0:32583:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:2.0:1790964079.750033:0:32583:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964079.750035:0:32583:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:2.0:1790964079.750038:0:32583:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000923d726c x1877961927036416/t0(0) o400->e5c322e7-c837-4fbe-89d7-d887ea2ad81f@0@lo:655/0 lens 224/224 e 0 to 0 dl 1790964090 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790964079.750046:0:32583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000923d726c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+11:31729:x1877961927036416:12345-0@lo:400: Request processed in 227us (2615us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964079.750061:0:32583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00000040:2.0:1790964079.750063:0:32583:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002ab79817 : new rpc_count 0 00000100:00000001:2.0:1790964079.750065:0:32583:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:2.0:1790964079.750067:0:32583:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:2.0:1790964079.750070:0:32583:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 00000000f228a1ea. 00000020:00000010:2.0:1790964079.750074:0:32583:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 0000000054bf6c75. 00000020:00000010:2.0:1790964079.750077:0:32583:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000085cd4c9c. 00000020:00000040:2.0:1790964079.750100:0:32583:0:(genops.c:879:class_export_put()) PUTting export 000000002ab79817 : new refcount 10 02000000:00000001:2.0:1790964079.750105:0:32583:0:(sec.c:2614:sptlrpc_svc_free_rs()) Process entered 02000000:00000010:2.0:1790964079.750107:0:32583:0:(sec_null.c:332:null_free_rs()) kvfree 'rs': 520 at 00000000234964a7. 02000000:00000001:2.0:1790964079.750110:0:32583:0:(sec.c:2627:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:2.0:1790964079.750112:0:32583:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:2.0:1790964079.750116:0:32583:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000400:00000010:2.0:1790964079.750120:0:32583:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 000000005c4b01c3. 00000400:00000010:2.0:1790964079.750125:0:32583:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at 000000001c8dc3bd. 00000100:00000001:3.0:1790964079.755268:0:32592:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:3.0:1790964079.755277:0:32592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927036544 02000000:00000001:3.0:1790964079.755282:0:32592:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:3.0:1790964079.755285:0:32592:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1790964079.755287:0:32592:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964079.755294:0:32592:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964079.755299:0:32592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927036544 00000020:00000001:3.0:1790964079.755302:0:32592:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:3.0:1790964079.755303:0:32592:0:(genops.c:804:class_conn2export()) looking for export cookie 0x0 00000020:00000001:3.0:1790964079.755305:0:32592:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000001:3.0:1790964079.755308:0:32592:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964079.755309:0:32592:0:(genops.c:806:class_conn2export()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:3.0:1790964079.755316:0:32592:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ec3bd4c6. 00000020:00000010:3.0:1790964079.755322:0:32592:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 00000000549e8b91. 00000020:00000010:3.0:1790964079.755327:0:32592:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 000000006de04d0d. 00000100:00000001:3.0:1790964079.755332:0:32592:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:3.0:1790964079.755333:0:32592:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:3.0:1790964079.755336:0:32592:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964079.755342:0:32592:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964079.755356:0:32592:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964079.755369:0:32592:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:3.0:1790964079.755370:0:32592:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:3.0:1790964079.755377:0:32592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00000001:3.0:1790964079.755400:0:32592:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446629657336972160 : -114416372579456 : ffff97f05cc18380) 00000020:00000010:2.0:1790964079.755405:0:32589:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 00000000fb211e12. 00000100:00000040:3.0:1790964079.755406:0:32592:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@00000000edacd42a x1877961927036544/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1790964099 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964079.755409:0:32589:0:(service.c:3454:ptlrpc_start_thread()) Process entered 00000100:00100000:2.0:1790964079.755411:0:32589:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1790964079.755417:0:32592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000edacd42a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:31726:x1877961927036544:12345-0@lo:38: 00000100:00000010:2.0:1790964079.755417:0:32589:0:(service.c:3473:ptlrpc_start_thread()) kmalloced '(thread)': 328 at 0000000085cd4c9c. 00000100:00000200:3.0:1790964079.755420:0:32592:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877961927036544 00000100:00100000:2.0:1790964079.755420:0:32589:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000020:00000001:3.0:1790964079.755424:0:32592:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00010000:00000001:3.0:1790964079.755428:0:32592:0:(ldlm_lib.c:1174:target_handle_connect()) Process entered 00000020:00000040:3.0:1790964079.755439:0:32592:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (000000004b9db861) now 4 - find 00000020:00000001:3.0:1790964079.755442:0:32592:0:(genops.c:655:class_str2obd()) Process leaving (rc=18446629656919683968 : -114416789867648 : ffff97f043e23380) 00000100:00000001:3.0:1790964079.755448:0:32592:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:3.0:1790964079.755451:0:32592:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:3.0:1790964079.755455:0:32592:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 712 at 00000000b7e6c247. 02000000:00000001:3.0:1790964079.755458:0:32592:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964079.755459:0:31729:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964079.755460:0:32592:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:3.0:1790964079.755462:0:32592:0:(ldlm_lib.c:1263:target_handle_connect()) lustre-MDT0000: ocd_connect_flags: 0x2041401047000022 tmp_exp_old_falloc: 0 00000100:00000001:2.0:1790964079.755463:0:31729:0:(client.c:1991:ptlrpc_check_set()) Process entered 00010000:00080000:3.0:1790964079.755469:0:32592:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 941 last 0 00010000:00000001:3.0:1790964079.755472:0:32592:0:(obd_class.h:859:obd_connect()) Process entered 00000400:00000001:2.0:1790964079.755472:0:31729:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1790964079.755474:0:31729:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000004:00000001:3.0:1790964079.755475:0:32592:0:(mdt_handler.c:7495:mdt_obd_connect()) Process entered 00000400:00000010:2.0:1790964079.755478:0:31729:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000eae732d3. 00000020:00000001:3.0:1790964079.755493:0:32592:0:(genops.c:1375:class_connect()) Process entered 00000020:00000001:3.0:1790964079.755495:0:32592:0:(genops.c:931:__class_new_export()) Process entered 00000020:00000010:3.0:1790964079.755497:0:32592:0:(genops.c:933:__class_new_export()) kmalloced '(export)': 1208 at 00000000e69d572d. 00000400:00000200:2.0:1790964079.755498:0:31729:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000009552156f 00000020:00000001:3.0:1790964079.755499:0:32592:0:(lustre_handles.c:61:class_handle_hash()) Process entered 00000400:00000010:2.0:1790964079.755500:0:31729:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000009552156f. 00000020:00000040:3.0:1790964079.755501:0:32592:0:(lustre_handles.c:93:class_handle_hash()) added object 00000000e69d572d with handle 0x6a601b0c127d5159 to hash 00000020:00000001:3.0:1790964079.755503:0:32592:0:(lustre_handles.c:94:class_handle_hash()) Process leaving 00000100:00000001:2.0:1790964079.755503:0:31729:0:(events.c:80:reply_in_callback()) Process entered 00000020:00000001:3.0:1790964079.755506:0:32592:0:(obd_class.h:1015:obd_init_export()) Process entered 00000004:00000001:3.0:1790964079.755508:0:32592:0:(mdt_handler.c:7614:mdt_init_export()) Process entered 00000100:00000200:2.0:1790964079.755508:0:31729:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@00000000397d6266 x1877961927036416/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964095 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000004:00000010:3.0:1790964079.755510:0:32592:0:(mdt_handler.c:7623:mdt_init_export()) kmalloced '(exp->exp_used_slots)': 64 at 000000004c459a85. 00000001:00000001:3.0:1790964079.755513:0:32592:0:(tgt_lastrcvd.c:423:tgt_client_alloc()) Process entered 00000001:00000010:3.0:1790964079.755516:0:32592:0:(tgt_lastrcvd.c:431:tgt_client_alloc()) kmalloced '(exp->u.eu_target_data.ted_lcd)': 128 at 000000003a20508c. 00000100:00000200:2.0:1790964079.755516:0:31729:0:(events.c:104:reply_in_callback()) @@@ unlink req@00000000397d6266 x1877961927036416/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964095 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000001:00000001:3.0:1790964079.755518:0:32592:0:(tgt_lastrcvd.c:438:tgt_client_alloc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964079.755521:0:32592:0:(ldlm_lockd.c:3138:ldlm_init_export()) Process entered 00000001:00000001:3.0:1790964079.755523:0:32592:0:(hash.c:1038:cfs_hash_create()) Process entered 00000100:00000001:2.0:1790964079.755523:0:31729:0:(events.c:165:reply_in_callback()) Process leaving 00000001:00000010:3.0:1790964079.755526:0:32592:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at 00000000330e4c6a. 00000100:00000001:2.0:1790964079.755530:0:31729:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964079.755532:0:31729:0:(client.c:1593:after_reply()) Process entered 00000001:00000010:3.0:1790964079.755534:0:32592:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at 0000000072c584b8. 02000000:00000001:2.0:1790964079.755534:0:31729:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1790964079.755536:0:31729:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1790964079.755538:0:31729:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 00000001:00000010:3.0:1790964079.755540:0:32592:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 0000000088cc4426. 02000000:00000001:2.0:1790964079.755540:0:31729:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000001:00000010:3.0:1790964079.755543:0:32592:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 00000000ffa1a6ae. 00000001:00000010:3.0:1790964079.755544:0:32592:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 000000004e0a50cb. 00000100:00001000:2.0:1790964079.755545:0:31729:0:(import.c:2195:obd_at_measure()) add 5 to 000000000b342ca4 time=6 v=5 (5 0 0 0) 00000001:00000010:3.0:1790964079.755546:0:32592:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 0000000038016942. 00000001:00000001:3.0:1790964079.755549:0:32592:0:(hash.c:1038:cfs_hash_create()) Process entered 00000100:00001000:2.0:1790964079.755549:0:31729:0:(import.c:2195:obd_at_measure()) add 1 to 0000000065e52807 time=6 v=5 (1 0 0 0) 00000001:00000010:3.0:1790964079.755551:0:32592:0:(hash.c:1065:cfs_hash_create()) alloc '(hs)': 232 at 00000000962c1a2e. 00000100:00000001:2.0:1790964079.755551:0:31729:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000001:00000010:3.0:1790964079.755553:0:32592:0:(hash.c:933:cfs_hash_buckets_realloc()) alloc '(new_bkts)': 32 at 000000009a41ab35. 00000100:00000001:2.0:1790964079.755553:0:31729:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00000001:00000010:3.0:1790964079.755555:0:32592:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 0000000012be3d18. 00010000:00000001:2.0:1790964079.755555:0:31729:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00000001:00000010:3.0:1790964079.755557:0:32592:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 00000000b889ff7a. 00010000:00000001:2.0:1790964079.755558:0:31729:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000001:00000010:3.0:1790964079.755559:0:32592:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 00000000c157c50a. 00000100:00000001:2.0:1790964079.755560:0:31729:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000001:00000010:3.0:1790964079.755561:0:32592:0:(hash.c:946:cfs_hash_buckets_realloc()) alloc '(new_bkts[i])': 344 at 000000002d0b8294. 00010000:00000001:3.0:1790964079.755562:0:32592:0:(ldlm_flock.c:1138:ldlm_init_flock_export()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964079.755564:0:32592:0:(ldlm_lockd.c:3157:ldlm_init_export()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964079.755564:0:31729:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@00000000397d6266 x1877961927036416/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000004:00000001:3.0:1790964079.755566:0:32592:0:(mdt_handler.c:7640:mdt_init_export()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964079.755568:0:32592:0:(obd_class.h:1019:obd_init_export()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964079.755570:0:31729:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000020:00000040:3.0:1790964079.755571:0:32592:0:(genops.c:868:class_export_get()) GET export 00000000e69d572d refcount=3 00000100:00000001:2.0:1790964079.755573:0:31729:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000020:00000040:3.0:1790964079.755575:0:32592:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (000000004b9db861) now 5 - export 00000100:00000001:2.0:1790964079.755575:0:31729:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:3.0:1790964079.755577:0:32592:0:(genops.c:1001:__class_new_export()) Process leaving (rc=18446629657920555008 : -114415788996608 : ffff97f07f8a4800) 00000100:00000040:2.0:1790964079.755578:0:31729:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000397d6266 x1877961927036416/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964095 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:00000040:3.0:1790964079.755580:0:32592:0:(genops.c:879:class_export_put()) PUTting export 00000000e69d572d : new refcount 2 00000020:00000080:3.0:1790964079.755582:0:32592:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x6a601b0c127d5159 00000020:00000001:3.0:1790964079.755584:0:32592:0:(genops.c:1386:class_connect()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964079.755584:0:31729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000397d6266 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:31729:1877961927036416:0@lo:400: 00000020:00000001:3.0:1790964079.755586:0:32592:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:3.0:1790964079.755587:0:32592:0:(genops.c:804:class_conn2export()) looking for export cookie 0x6a601b0c127d5159 00000020:00000001:3.0:1790964079.755588:0:32592:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1790964079.755589:0:32592:0:(lustre_handles.c:148:class_handle2object()) GET export 00000000e69d572d refcount=3 00000100:00000001:2.0:1790964079.755589:0:31729:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:3.0:1790964079.755591:0:32592:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446629657920555008 : -114415788996608 : ffff97f07f8a4800) 00000100:00000001:2.0:1790964079.755592:0:31729:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000020:00000001:3.0:1790964079.755593:0:32592:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446629657920555008 : -114415788996608 : ffff97f07f8a4800) 00000100:00000040:2.0:1790964079.755594:0:31729:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@00000000397d6266 x1877961927036416/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964095 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000001:00000001:3.0:1790964079.755596:0:32592:0:(nodemap_handler.c:735:nodemap_add_member()) Process entered 00000001:00000001:3.0:1790964079.755598:0:32592:0:(nodemap_handler.c:520:nodemap_classify_nid()) Process entered 00000100:00000001:2.0:1790964079.755601:0:31729:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1790964079.755603:0:31729:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 00000001:00000040:3.0:1790964079.755605:0:32592:0:(nodemap_handler.c:533:nodemap_classify_nid()) found nid 192.168.201.147@tcp 02000000:00000010:2.0:1790964079.755605:0:31729:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 0000000086e8aa9e. 00000001:00000040:3.0:1790964079.755609:0:32592:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=00000000f927014a) : new refcount 5 02000000:00000001:2.0:1790964079.755609:0:31729:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000001:00000001:3.0:1790964079.755611:0:32592:0:(nodemap_handler.c:558:nodemap_classify_nid()) Process leaving (rc=18446629657952207872 : -114415757343744 : ffff97f0816d4400) 00000020:00000001:2.0:1790964079.755611:0:31729:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:2.0:1790964079.755612:0:31729:0:(genops.c:1223:class_import_put()) import 00000000f7398c40 refcount=3 obd=MGC192.168.201.147@tcp 00000020:00000001:2.0:1790964079.755614:0:31729:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:2.0:1790964079.755616:0:31729:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at 00000000d58888bf. 00000001:00000001:3.0:1790964079.755617:0:32592:0:(nodemap_member.c:132:nm_member_add()) Process entered 00000020:00000040:3.0:1790964079.755619:0:32592:0:(genops.c:868:class_export_get()) GET export 00000000e69d572d refcount=4 00000001:00000040:3.0:1790964079.755620:0:32592:0:(nodemap_handler.c:99:nodemap_getref()) GETting nodemap default(p=00000000f927014a) : new refcount 6 02000000:00000001:2.0:1790964079.755621:0:31729:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 00000020:00000010:3.0:1790964079.755626:0:32592:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 608 at 0000000038920366. 02000000:00000001:2.0:1790964079.755627:0:31729:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1790964079.755628:0:31729:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 00000000397d6266. 00000020:00000010:3.0:1790964079.755630:0:32592:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 2752 at 000000002daf925f. 00000100:00000001:2.0:1790964079.755632:0:31729:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1790964079.755633:0:31729:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964079.755635:0:31729:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964079.755640:0:31729:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964079.755642:0:31729:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964079.755643:0:31729:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964079.755645:0:31729:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000001:00000001:3.0:1790964079.755654:0:32592:0:(nodemap_member.c:170:nm_member_add()) Process leaving (rc=0 : 0 : 0) 00000001:08000000:3.0:1790964079.755658:0:32592:0:(nodemap_handler.c:809:nodemap_add_member()) lustre-MDT0000: adding NID 0@lo to nodemap default 00000001:00000040:3.0:1790964079.755661:0:32592:0:(nodemap_handler.c:115:nodemap_putref()) PUTting nodemap default(p=00000000f927014a) : new refcount 5 00000001:00000001:3.0:1790964079.755663:0:32592:0:(nodemap_handler.c:815:nodemap_add_member()) Process leaving (rc=0 : 0 : 0) 00000004:00100000:3.0:1790964079.755667:0:32592:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000001:3.0:1790964079.755670:0:32592:0:(tgt_lastrcvd.c:1061:tgt_client_new()) Process entered 00000001:00000001:3.0:1790964079.755672:0:32592:0:(tgt_lastrcvd.c:1068:tgt_client_new()) Process leaving (rc=0 : 0 : 0) 00000004:00000001:3.0:1790964079.755674:0:32592:0:(mdt_fs.c:50:mdt_export_stats_init()) Process entered 00000020:00000001:3.0:1790964079.755677:0:32592:0:(lprocfs_status_server.c:708:lprocfs_exp_setup()) Process entered 00000020:00000010:3.0:1790964079.755680:0:32592:0:(lprocfs_status_server.c:729:lprocfs_exp_setup()) kmalloced '(new_stat)': 96 at 0000000014da441c. 00000020:00000040:3.0:1790964079.755685:0:32592:0:(lprocfs_status_server.c:748:lprocfs_exp_setup()) Found stats 0000000014da441c for nid 0@lo - ref 2 00000020:00000001:3.0:1790964079.755735:0:32592:0:(lprocfs_status_server.c:781:lprocfs_exp_setup()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:3.0:1790964079.755740:0:32592:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 584 at 00000000ae8c27e7. 00000020:00000010:3.0:1790964079.755743:0:32592:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 1728 at 000000007ff52ae7. 00000020:00000010:3.0:1790964079.755746:0:32592:0:(lprocfs_status.c:1469:lprocfs_stats_alloc()) alloc '(stats->ls_percpu[0])': 1080 at 00000000600939e4. 00000020:00000010:3.0:1790964079.755767:0:32592:0:(lprocfs_status.c:1450:lprocfs_stats_alloc()) alloc '(stats)': 584 at 0000000012174f3e. 00000020:00000010:3.0:1790964079.755770:0:32592:0:(lprocfs_status.c:1462:lprocfs_stats_alloc()) alloc '(stats->ls_cnt_header)': 448 at 000000006e017320. 00000100:00000001:2.0:1790964079.755770:0:32589:0:(service.c:3543:ptlrpc_start_thread()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:3.0:1790964079.755772:0:32592:0:(lprocfs_status.c:1469:lprocfs_stats_alloc()) alloc '(stats->ls_percpu[0])': 280 at 00000000bea08ed5. 00000100:00000001:2.0:1790964079.755777:0:32898:0:(service.c:3019:ptlrpc_main()) Process entered 00000004:00000001:3.0:1790964079.755784:0:32592:0:(mdt_fs.c:75:mdt_export_stats_init()) Process leaving (rc=0 : 0 : 0) 00000004:00000001:3.0:1790964079.755787:0:32592:0:(mdt_handler.c:7562:mdt_obd_connect()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:2.0:1790964079.755787:0:32898:0:(service.c:3046:ptlrpc_main()) kmalloced '(env)': 56 at 00000000575e2000. 00010000:00000001:3.0:1790964079.755789:0:32592:0:(obd_class.h:875:obd_connect()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:2.0:1790964079.755790:0:32898:0:(lu_object.c:1999:lu_env_add_task()) kmalloced '(lei)': 40 at 00000000e920f641. 00000020:00000010:3.0:1790964079.755794:0:32592:0:(genops.c:1264:class_new_import()) kmalloced '(imp)': 1720 at 00000000a8b8eba8. 00000020:00000040:3.0:1790964079.755795:0:32592:0:(obd_config.c:995:class_incref()) incref lustre-MDT0000 (000000004b9db861) now 6 - import 00000020:00000010:2.0:1790964079.755795:0:32898:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000086e8aa9e. 00000020:00000010:2.0:1790964079.755798:0:32898:0:(lu_object.c:568:lu_global_key_init()) kmalloced '(value)': 512 at 000000007f39cb3e. 00000020:00000001:3.0:1790964079.755800:0:32592:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:3.0:1790964079.755801:0:32592:0:(genops.c:1223:class_import_put()) import 00000000a8b8eba8 refcount=1 obd=lustre-MDT0000 00000040:00000010:2.0:1790964079.755802:0:32898:0:(llog_obd.c:218:llog_key_init()) kmalloced '(value)': 480 at 0000000066309a82. 00000020:00000001:3.0:1790964079.755803:0:32592:0:(genops.c:1230:class_import_put()) Process leaving 00000020:00000040:3.0:1790964079.755806:0:32592:0:(genops.c:868:class_export_get()) GET export 00000000e69d572d refcount=5 00000020:00000010:2.0:1790964079.755806:0:32898:0:(dt_object.c:33:dt_global_key_init()) kmalloced '(value)': 1264 at 000000002d24aa1f. 00000020:00000010:2.0:1790964079.755810:0:32898:0:(tgt_main.c:721:tgt_key_init()) slab-alloced 'thread': 1288 at 000000002c2a70fb. 00000100:00000040:3.0:1790964079.755812:0:32592:0:(service.c:1082:ptlrpc_request_change_export()) RPC GETting export 00000000e69d572d : new rpc_count 1 00000020:00000010:2.0:1790964079.755813:0:32898:0:(update_records.c:1179:update_key_init()) kmalloced '(value)': 432 at 00000000cd9b0ca5. 00000100:00000001:3.0:1790964079.755815:0:32592:0:(connection.c:105:ptlrpc_connection_get()) Process entered 80000000:00000010:2.0:1790964079.755817:0:32898:0:(fld_handler.c:35:fld_key_init()) kmalloced '(value)': 72 at 000000004a534aa7. 00000100:00000001:3.0:1790964079.755818:0:32592:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:3.0:1790964079.755820:0:32592:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000ae02bb19 refcount 15 to 0@lo 40000000:00000010:2.0:1790964079.755820:0:32898:0:(fid_handler.c:479:seq_key_init()) kmalloced '(value)': 48 at 000000004cdbbad9. 00000100:00000001:3.0:1790964079.755822:0:32592:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446629656951528384 : -114416758023232 : ffff97f045c81bc0) 00000100:00000001:3.0:1790964079.755825:0:32592:0:(connection.c:111:ptlrpc_connection_get()) Process leaving via out (rc=18446629656951528384 : -114416758023232 : 0xffff97f045c81bc0) 00100000:00000010:2.0:1790964079.755825:0:32898:0:(lfsck_lib.c:33:lfsck_key_init()) kmalloced '(value)': 1800 at 00000000a1f71c05. 00000100:00000040:3.0:1790964079.755828:0:32592:0:(connection.c:150:ptlrpc_connection_get()) conn=00000000ae02bb19 refcount 15 to 0@lo 00040000:00000010:2.0:1790964079.755828:0:32898:0:(lquota_lib.c:35:lquota_key_init()) kmalloced '(value)': 248 at 00000000d58888bf. 00000020:00000040:3.0:1790964079.755831:0:32592:0:(genops.c:868:class_export_get()) GET export 00000000e69d572d refcount=6 00040000:00000010:2.0:1790964079.755831:0:32898:0:(qmt_dev.c:349:qmt_key_init()) kmalloced '(value)': 1256 at 000000005f878674. 00040000:00000010:2.0:1790964079.755834:0:32898:0:(qsd_lib.c:51:qsd_key_init()) kmalloced '(value)': 408 at 00000000f1c5428f. 00000100:00000001:3.0:1790964079.755836:0:32592:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00080000:00000010:2.0:1790964079.755837:0:32898:0:(osd_handler.c:767:osd_key_init()) kmalloced '(info)': 2000 at 00000000e6c6b2ad. 00000100:00000040:3.0:1790964079.755838:0:32592:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000ae02bb19 refcount 16 to 0@lo 00000100:00000001:3.0:1790964079.755839:0:32592:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446629656951528384 : -114416758023232 : ffff97f045c81bc0) 00000004:00000010:2.0:1790964079.755841:0:32898:0:(mdd_device.c:2410:mdd_key_init()) kmalloced '(value)': 1872 at 0000000072d004bf. 02000000:00000001:3.0:1790964079.755842:0:32592:0:(sec.c:1579:sptlrpc_import_sec_adapt()) Process entered 02000000:00000001:3.0:1790964079.755845:0:32592:0:(sec.c:1444:sptlrpc_sec_create()) Process entered 00000004:00000010:2.0:1790964079.755845:0:32898:0:(mdt_handler.c:8401:mdt_key_init()) kmalloced '(value)': 2568 at 00000000da633b97. 02000000:08000000:3.0:1790964079.755847:0:32592:0:(sec.c:1452:sptlrpc_sec_create()) mdt lustre-MDT0000: reverse sec using flavor null 00000004:00000010:2.0:1790964079.755849:0:32898:0:(lod_dev.c:2369:lod_key_init()) kmalloced '(value)': 1224 at 000000008b51f857. 02000000:00000001:3.0:1790964079.755850:0:32592:0:(sec.c:1483:sptlrpc_sec_create()) Process leaving (rc=18446744072660202912 : -1049348704 : ffffffffc17435a0) 02000000:00000001:3.0:1790964079.755852:0:32592:0:(sec.c:1647:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0) 00002000:00000010:2.0:1790964079.755853:0:32898:0:(ofd_dev.c:3004:ofd_key_init()) kmalloced '(value)': 816 at 00000000234964a7. 00000100:00000001:3.0:1790964079.755855:0:32592:0:(import.c:1692:ptlrpc_import_recovery_state_machine()) Process entered 00000004:00000010:2.0:1790964079.755856:0:32898:0:(osp_dev.c:1831:osp_key_init()) kmalloced '(value)': 616 at 000000002fc19de6. 00000100:00000001:3.0:1790964079.755857:0:32592:0:(recover.c:149:ptlrpc_resend()) Process entered 00000100:00000001:3.0:1790964079.755859:0:32592:0:(recover.c:178:ptlrpc_resend()) Process leaving (rc=0 : 0 : 0) 00000100:00080000:3.0:1790964079.755861:0:32592:0:(import.c:65:import_set_state_nolock()) 00000000a8b8eba8 : changing import state from RECOVER to FULL 00000100:00000001:3.0:1790964079.755864:0:32592:0:(obd_class.h:1222:obd_import_event()) Process entered 00000100:00000001:3.0:1790964079.755867:0:32592:0:(obd_class.h:1233:obd_import_event()) Process leaving 00000100:00000001:3.0:1790964079.755869:0:32592:0:(import.c:1798:ptlrpc_import_recovery_state_machine()) Process leaving (rc=0 : 0 : 0) 00000020:00000040:3.0:1790964079.755871:0:32592:0:(genops.c:879:class_export_put()) PUTting export 00000000e69d572d : new refcount 5 00000020:00000040:3.0:1790964079.755874:0:32592:0:(obd_config.c:1023:class_decref()) Decref lustre-MDT0000 (000000004b9db861) now 6 - find 00010000:00000001:3.0:1790964079.755876:0:32592:0:(ldlm_lib.c:1741:target_handle_connect()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964079.755880:0:32592:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:3.0:1790964079.755882:0:32592:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072669826000 : -1039725616 : ffffffffc2070bd0) 00000020:00000001:3.0:1790964079.755885:0:32592:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:3.0:1790964079.755887:0:32592:0:(tgt_handler.c:559:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:3.0:1790964079.755889:0:32592:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:3.0:1790964079.755892:0:32592:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:3.0:1790964079.755894:0:32592:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964079.755897:0:32592:0:(tgt_handler.c:1061:tgt_connect()) Process entered 00000001:00000001:3.0:1790964079.755911:0:32592:0:(nodemap_handler.c:1096:nodemap_get_from_exp()) Process entered 00000001:00000001:3.0:1790964079.755913:0:32592:0:(nodemap_handler.c:1099:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0) 00000001:00000001:3.0:1790964079.755915:0:32592:0:(nodemap_handler.c:1096:nodemap_get_from_exp()) Process entered 00000001:00000001:3.0:1790964079.755916:0:32592:0:(nodemap_handler.c:1099:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964079.755918:0:32592:0:(tgt_handler.c:1130:tgt_connect()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:2.0:1790964079.755918:0:32898:0:(service.c:3073:ptlrpc_main()) kmalloced '(rs)': 131072 at 00000000cb3c3800. 00010000:00000040:3.0:1790964079.755921:0:32592:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877961927036544 00010000:00000001:3.0:1790964079.755924:0:32592:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:3.0:1790964079.755928:0:32592:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@00000000edacd42a x1877961927036544/t0(0) o38->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1790964099 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1790964079.755935:0:32592:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:3.0:1790964079.755937:0:32592:0:(ldlm_lib.c:3366:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1790964079.755939:0:32592:0:(import.c:2195:obd_at_measure()) add 1 to 000000003d86d497 time=1790964079 v=10 (0 0 0 0) 00000100:00001000:3.0:1790964079.755941:0:32592:0:(import.c:2261:obd_at_measure()) AT 000000003d86d497 change: old=10 new=5 delta=-5 (val=1) hist 1 0 0 0 00000100:00001000:3.0:1790964079.755944:0:32592:0:(niobuf.c:566:ptlrpc_at_set_reply()) @@@ svc mdt changed estimate from 10 to 5 req@00000000edacd42a x1877961927036544/t0(0) o38->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1790964099 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00001000:3.0:1790964079.755950:0:32592:0:(niobuf.c:600:ptlrpc_at_set_reply()) No early reply support: flags=0x1 req_flags=0x200 magic=bd00bd3/bd00bd3 len=416 00000100:00000001:3.0:1790964079.755952:0:32592:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:3.0:1790964079.755953:0:32592:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000ae02bb19 refcount 17 to 0@lo 00000100:00000001:3.0:1790964079.755954:0:32592:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446629656951528384 : -114416758023232 : ffff97f045c81bc0) 02000000:00000001:3.0:1790964079.755956:0:32592:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:3.0:1790964079.755958:0:32592:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964079.755961:0:32592:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000200:2.0:1790964079.756580:0:32898:0:(service.c:3107:ptlrpc_main()) service thread 3 (#4) started 00000100:00000040:2.0:1790964079.756594:0:31384:0:(connection.c:75:cpu_latency_work()) work item of 000000002f5f8e48 (cpu 2) has reached its deadline 4295608849, at 4295608856 00000100:00000010:2.0:1790964079.756602:0:31384:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 000000005618086a. 00000100:00000040:1.0:1790964079.760785:0:3119:0:(connection.c:75:cpu_latency_work()) work item of 000000002146c102 (cpu 1) has reached its deadline 4295608849, at 4295608856 00000100:00000010:1.0:1790964079.760800:0:3119:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 000000007cf71dd4. 00000100:00000040:3.0:1790964079.762495:0:32592:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:3.0:1790964079.762503:0:32592:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 0000000093a4317c. 00000100:00000200:3.0:1790964079.762510:0:32592:0:(niobuf.c:94:ptl_send_buf()) Sending 416 bytes to portal 10, xid 1877961927036544, offset 0 00000400:00000200:3.0:1790964079.762516:0:32592:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:3.0:1790964079.762527:0:32592:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:3.0:1790964079.762535:0:32592:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 416 into portal 10 MB=0x6abff15900e80 00000400:00000200:3.0:1790964079.762540:0:32592:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-0@lo of length 416/416 into md 0xab1 [1] + 0 00000400:00000200:3.0:1790964079.762547:0:32592:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1790964079.762550:0:32592:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:3.0:1790964079.762556:0:32592:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1790964079.762561:0:32592:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@0000000016edf9f6 x1877961927036544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964089 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1790964079.762579:0:32592:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=416 offset=0 replen=544 req@0000000016edf9f6 x1877961927036544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964089 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964079.762590:0:32592:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:3.0:1790964079.762597:0:32592:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 0000000093a4317c 00000400:00000010:3.0:1790964079.762599:0:32592:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 0000000093a4317c. 00000100:00000001:3.0:1790964079.762601:0:32592:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:3.0:1790964079.762602:0:32592:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:3.0:1790964079.762606:0:32592:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964079.762608:0:32592:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000ae02bb19 refcount 16 to 0@lo 00010000:00000001:3.0:1790964079.762610:0:32592:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:3.0:1790964079.762612:0:32592:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964079.762614:0:32592:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:3.0:1790964079.762618:0:32592:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000edacd42a x1877961927036544/t0(0) o38->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:0/0 lens 520/416 e 0 to 0 dl 1790964099 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790964079.762624:0:32592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000edacd42a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:31726:x1877961927036544:12345-0@lo:38: Request processed in 7208us (14405us total) trans 0 rc 0/0 00000100:00100000:3.0:1790964079.762632:0:32592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00000040:3.0:1790964079.762634:0:32592:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e69d572d : new rpc_count 0 00000100:00000001:3.0:1790964079.762636:0:32592:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:3.0:1790964079.762637:0:32592:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:3.0:1790964079.762642:0:32592:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 00000000549e8b91. 00000020:00000010:3.0:1790964079.762646:0:32592:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 000000006de04d0d. 00000020:00000010:3.0:1790964079.762648:0:32592:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ec3bd4c6. 00000020:00000040:3.0:1790964079.762653:0:32592:0:(genops.c:879:class_export_put()) PUTting export 00000000e69d572d : new refcount 4 00000100:00000001:3.0:1790964079.762655:0:32592:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1790964079.762740:0:12040:0:(connection.c:75:cpu_latency_work()) work item of 00000000ae8cb54c (cpu 3) has reached its deadline 4295608849, at 4295608856 00000100:00000010:3.0:1790964079.762747:0:12040:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000be43824c. 00000100:00000001:3.0:1790964079.762758:0:31726:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964079.762761:0:31726:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1790964079.762767:0:31726:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1790964079.762769:0:31726:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1790964079.762771:0:31726:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 0000000068a21e5b. 00000400:00000200:3.0:1790964079.762779:0:31726:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000009735db84 00000400:00000010:3.0:1790964079.762781:0:31726:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000009735db84. 00000100:00000001:3.0:1790964079.762785:0:31726:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1790964079.762788:0:31726:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@0000000016edf9f6 x1877961927036544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964089 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1790964079.762793:0:31726:0:(events.c:104:reply_in_callback()) @@@ unlink req@0000000016edf9f6 x1877961927036544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1790964089 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964079.762797:0:31726:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:3.0:1790964079.762798:0:31726:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964079.762800:0:31726:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:3.0:1790964079.762802:0:31726:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1790964079.762803:0:31726:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1790964079.762805:0:31726:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964079.762807:0:31726:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:3.0:1790964079.762814:0:31726:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 00000000f9c09c43. 00000100:00001000:3.0:1790964079.762818:0:31726:0:(import.c:2195:obd_at_measure()) add 5 to 000000005f041a34 time=1790964079 v=5 (0 0 0 0) 00000100:00001000:3.0:1790964079.762821:0:31726:0:(import.c:2195:obd_at_measure()) add 1 to 0000000098fc34f8 time=5 v=5 (1 0 0 0) 00000100:00000001:3.0:1790964079.762823:0:31726:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1790964079.762824:0:31726:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964079.762826:0:31726:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00080000:3.0:1790964079.762828:0:31726:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000016edf9f6 x1877961927036544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790964089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:3.0:1790964079.762832:0:31726:0:(ldlm_request.c:1672:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964079.762834:0:31726:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000100:00000040:3.0:1790964079.762835:0:31726:0:(client.c:3122:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000001:3.0:1790964079.762836:0:31726:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:3.0:1790964079.762837:0:31726:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964079.762839:0:31726:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@0000000016edf9f6 x1877961927036544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790964089 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964079.762842:0:31726:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1790964079.762844:0:31726:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1790964079.762846:0:31726:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964079.762847:0:31726:0:(import.c:1101:ptlrpc_connect_interpret()) Process entered 00000100:00080000:3.0:1790964079.762852:0:31726:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000020:00000001:3.0:1790964079.762857:0:31726:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:3.0:1790964079.762858:0:31726:0:(genops.c:804:class_conn2export()) looking for export cookie 0x6a601b0c127d514b 00000020:00000001:3.0:1790964079.762859:0:31726:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1790964079.762861:0:31726:0:(lustre_handles.c:148:class_handle2object()) GET export 000000008051da39 refcount=7 00000020:00000001:3.0:1790964079.762863:0:31726:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446629656913846272 : -114416795705344 : ffff97f043892000) 00000020:00000001:3.0:1790964079.762864:0:31726:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446629656913846272 : -114416795705344 : ffff97f043892000) 00000100:00001000:3.0:1790964079.762867:0:31726:0:(import.c:2195:obd_at_measure()) add 1 to 0000000098fc34f8 time=1790964079 v=0 (0 0 0 0) 00000100:00001000:3.0:1790964079.762868:0:31726:0:(import.c:2261:obd_at_measure()) AT 0000000098fc34f8 change: old=0 new=5 delta=5 (val=1) hist 1 0 0 0 00000100:00080000:3.0:1790964079.762924:0:31726:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000020:00000040:3.0:1790964079.762927:0:31726:0:(genops.c:879:class_export_put()) PUTting export 000000008051da39 : new refcount 6 00000100:00000001:3.0:1790964079.762929:0:31726:0:(obd_class.h:1222:obd_import_event()) Process entered 00000100:00000001:3.0:1790964079.762931:0:31726:0:(obd_class.h:1233:obd_import_event()) Process leaving 00000100:00080000:3.0:1790964079.762932:0:31726:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1790964079.762935:0:31726:0:(import.c:65:import_set_state_nolock()) 000000007c9fe86f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00000001:3.0:1790964079.762936:0:31726:0:(obd_class.h:1222:obd_import_event()) Process entered 00000100:00000001:3.0:1790964079.762937:0:31726:0:(obd_class.h:1233:obd_import_event()) Process leaving 00000100:00000001:3.0:1790964079.762938:0:31726:0:(import.c:1285:ptlrpc_connect_interpret()) Process leaving via finish (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1790964079.762940:0:31726:0:(import.c:1692:ptlrpc_import_recovery_state_machine()) Process entered 00000100:00000001:3.0:1790964079.762942:0:31726:0:(import.c:1798:ptlrpc_import_recovery_state_machine()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964079.762944:0:31726:0:(import.c:1561:ptlrpc_connect_interpret()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964079.762946:0:31726:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@0000000016edf9f6 x1877961927036544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790964089 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790964079.762950:0:31726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000016edf9f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:31726:1877961927036544:0@lo:38: 00000100:00000001:3.0:1790964079.762953:0:31726:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964079.762955:0:31726:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964079.762957:0:31726:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@0000000016edf9f6 x1877961927036544/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1790964089 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964079.762961:0:31726:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1790964079.762963:0:31726:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1790964079.762966:0:31726:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000de39ad8d. 02000000:00000001:3.0:1790964079.762969:0:31726:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1790964079.762979:0:31726:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:3.0:1790964079.762980:0:31726:0:(genops.c:1223:class_import_put()) import 000000007c9fe86f refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000020:00000001:3.0:1790964079.762982:0:31726:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:3.0:1790964079.762985:0:31726:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 1024 at 00000000a1f03811. 02000000:00000001:3.0:1790964079.762988:0:31726:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1790964079.762990:0:31726:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1790964079.762992:0:31726:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 0000000016edf9f6. 00000100:00000001:3.0:1790964079.762995:0:31726:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1790964079.762997:0:31726:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964079.762999:0:31726:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964079.763001:0:31726:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964079.763002:0:31726:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964079.763004:0:31726:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964079.763005:0:31726:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964079.763228:0:127:0:(connection.c:75:cpu_latency_work()) work item of 0000000021367367 (cpu 0) has reached its deadline 4295608849, at 4295608862 00000100:00000010:0.0:1790964079.763234:0:127:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 000000001af32f20. 00080000:00000001:1.0:1790964079.766069:0:32883:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:1.0:1790964079.766088:0:32883:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964079.766094:0:32883:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964080.054358:0:31384:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:2.0:1790964080.054367:0:31384:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964080.054388:0:31384:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:2.0:1790964080.054390:0:31384:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964080.054457:0:32578:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1790964080.054461:0:32578:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1790964080.054463:0:32578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000001:1.0:1790964080.503188:0:32628:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:1.0:1790964080.503196:0:32628:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964080.503199:0:32628:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964080.503204:0:32628:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017495dc3 going to sleep for 0 seconds 00000100:00000001:1.0:1790964080.503208:0:32628:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964080.503211:0:32628:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964080.503214:0:32628:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1790964080.503216:0:32628:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964080.503219:0:32628:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964080.756625:0:31726:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:3.0:1790964080.756682:0:31726:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964080.756684:0:31726:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964080.756689:0:31726:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964080.756692:0:31726:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964080.756695:0:31726:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964080.756697:0:31726:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:2.0:1790964080.757759:0:32577:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 00000000552cb897. 00000020:00000010:3.0:1790964080.757767:0:32574:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 00000000691aa6fc. 00000100:00000001:3.0:1790964080.757781:0:32574:0:(service.c:1710:ptlrpc_at_check_timed()) Process entered 00000100:00000001:2.0:1790964080.757781:0:32577:0:(service.c:1710:ptlrpc_at_check_timed()) Process entered 00000100:00000001:3.0:1790964080.757783:0:32574:0:(service.c:1721:ptlrpc_at_check_timed()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964080.757784:0:32577:0:(service.c:1721:ptlrpc_at_check_timed()) Process leaving (rc=0 : 0 : 0) 00080000:00000001:1.0:1790964080.880900:0:32937:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:1.0:1790964080.880916:0:32937:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964080.880921:0:32937:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964081.076557:0:31384:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:2.0:1790964081.076567:0:31384:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964081.076574:0:31384:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:2.0:1790964081.076575:0:31384:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964081.076710:0:32579:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1790964081.076715:0:32579:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1790964081.076718:0:32579:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000001:1.0:1790964081.524846:0:32628:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:1.0:1790964081.524853:0:32628:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964081.524855:0:32628:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964081.524859:0:32628:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017495dc3 going to sleep for 0 seconds 00000100:00000001:1.0:1790964081.524865:0:32628:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964081.524869:0:32628:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964081.524872:0:32628:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1790964081.524875:0:32628:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964081.524877:0:32628:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:3.0:1790964081.780656:0:32587:0:(mgc_request.c:105:config_log_get()) Process entered 00000100:00000001:2.0:1790964081.780658:0:31726:0:(client.c:2568:ptlrpc_expired_set()) Process entered 10000000:00000040:3.0:1790964081.780665:0:32587:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (000000003d127acf) refs 2 10000000:00000001:3.0:1790964081.780672:0:32587:0:(mgc_request.c:109:config_log_get()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964081.780674:0:31726:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 10000000:00000001:3.0:1790964081.780675:0:32587:0:(mgc_request.c:117:config_log_put()) Process entered 10000000:00000001:3.0:1790964081.780678:0:32587:0:(mgc_request.c:120:config_log_put()) Process leaving 00000100:00000001:2.0:1790964081.780678:0:31726:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 10000000:00000001:3.0:1790964081.780681:0:32587:0:(mgc_request.c:601:do_requeue()) Process entered 00000100:00000001:2.0:1790964081.780684:0:31726:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 10000000:01000000:3.0:1790964081.780685:0:32587:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 00000100:00000001:2.0:1790964081.780688:0:31726:0:(client.c:1991:ptlrpc_check_set()) Process entered 10000000:00000001:3.0:1790964081.780689:0:32587:0:(mgc_request.c:1783:mgc_process_log()) Process entered 10000000:01000000:3.0:1790964081.780693:0:32587:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff97ef487e6000 from 9 00000100:00000001:2.0:1790964081.780694:0:31726:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:3.0:1790964081.780698:0:32587:0:(mgc_request.c:990:mgc_enqueue()) Process entered 00000100:00000001:2.0:1790964081.780699:0:31726:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 10000000:01000000:3.0:1790964081.780701:0:32587:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00000100:00000010:3.0:1790964081.780715:0:32587:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 000000009592a7ec. 00000020:00000040:3.0:1790964081.780737:0:32587:0:(genops.c:1210:class_import_get()) import 00000000f7398c40 refcount=4 obd=MGC192.168.201.147@tcp 00000100:00000001:3.0:1790964081.780742:0:32587:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1790964081.780745:0:32587:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1790964081.780750:0:32587:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1790964081.780756:0:32587:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at 000000000078407d. 00000100:00000001:3.0:1790964081.780763:0:32587:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964081.780767:0:32587:0:(ldlm_request.c:1064:ldlm_cli_enqueue()) Process entered 00010000:00000001:3.0:1790964081.780770:0:32587:0:(ldlm_lock.c:1700:ldlm_lock_create()) Process entered 00010000:00000010:3.0:1790964081.780776:0:32587:0:(ldlm_resource.c:1510:ldlm_resource_new()) slab-alloced 'res': 256 at 00000000b92e1a43. 00010000:00000001:3.0:1790964081.780781:0:32587:0:(ldlm_lock.c:433:ldlm_lock_new()) Process entered 00010000:00000010:3.0:1790964081.780784:0:32587:0:(ldlm_lock.c:437:ldlm_lock_new()) slab-alloced 'lock': 512 at 0000000065206fdc. 00000020:00000001:3.0:1790964081.780788:0:32587:0:(lustre_handles.c:61:class_handle_hash()) Process entered 00000020:00000040:3.0:1790964081.780791:0:32587:0:(lustre_handles.c:93:class_handle_hash()) added object 0000000065206fdc with handle 0x6a601b0c127d5160 to hash 00000020:00000001:3.0:1790964081.780793:0:32587:0:(lustre_handles.c:94:class_handle_hash()) Process leaving 00010000:00000001:3.0:1790964081.780794:0:32587:0:(ldlm_lock.c:488:ldlm_lock_new()) Process leaving (rc=18446629657950518272 : -114415759033344 : ffff97f081537c00) 00010000:00000001:3.0:1790964081.780796:0:32587:0:(ldlm_lock.c:1741:ldlm_lock_create()) Process leaving (rc=18446629657950518272 : -114415759033344 : ffff97f081537c00) 00010000:00000001:3.0:1790964081.780799:0:32587:0:(ldlm_lock.c:261:ldlm_lock_remove_from_lru_check()) Process entered 00010000:00000001:3.0:1790964081.780802:0:32587:0:(ldlm_lock.c:280:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1790964081.780805:0:32587:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.147@tcp lock: 0000000065206fdc/0x6a601b0c127d5160 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 32587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964081.780813:0:32587:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.147@tcp lock: 0000000065206fdc/0x6a601b0c127d5160 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 32587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1790964081.780822:0:32587:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.147@tcp lock: 0000000065206fdc/0x6a601b0c127d5160 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 32587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00000001:3.0:1790964081.780827:0:32587:0:(client.c:3353:ptlrpc_queue_wait()) Process entered 00000100:00000001:3.0:1790964081.780828:0:32587:0:(client.c:1169:ptlrpc_prep_set()) Process entered 00000100:00000010:3.0:1790964081.780835:0:32587:0:(client.c:1171:ptlrpc_prep_set()) kmalloced '(set)': 144 at 000000001167c2c3. 00000100:00000001:3.0:1790964081.780837:0:32587:0:(client.c:1186:ptlrpc_prep_set()) Process leaving (rc=18446629657338854592 : -114416370697024 : ffff97f05cde3cc0) 00000100:00000001:3.0:1790964081.780839:0:32587:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1790964081.780840:0:32587:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446629657911025536 : -114415798526080 : ffff97f07ef8df80) 00000100:00000001:3.0:1790964081.780893:0:32587:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1790964081.780900:0:32587:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964081.780903:0:32587:0:(client.c:2689:ptlrpc_set_wait()) Process entered 00000100:00000001:3.0:1790964081.780905:0:32587:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1790964081.780911:0:32587:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@000000009592a7ec x1877961927036672/t0(0) o101->MGC192.168.201.147@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964081.780921:0:32587:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1790964081.780923:0:32587:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964081.780926:0:32587:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1790964081.780935:0:32587:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1790964081.780938:0:32587:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964081.780940:0:32587:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009592a7ec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32587:1877961927036672:0@lo:101: 00000100:00000001:3.0:1790964081.780944:0:32587:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1790964081.780950:0:32587:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1790964081.780952:0:32587:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964081.780954:0:32587:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1790964081.780958:0:32587:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000003c7dbbaf. 02000000:00000001:3.0:1790964081.780959:0:32587:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1790964081.780965:0:32587:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000bae4f811. 00000400:00000010:3.0:1790964081.780971:0:32587:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 0000000093a4317c. 00000100:00000200:3.0:1790964081.780977:0:32587:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1877961927036672, portal 25 00000100:00000001:3.0:1790964081.780979:0:32587:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1790964081.780979:0:32587:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446629657911025536 : -114415798526080 : ffff97f07ef8df80) 00000100:00000040:3.0:1790964081.780983:0:32587:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@000000009592a7ec x1877961927036672/t0(0) o101->MGC192.168.201.147@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964097 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964081.780990:0:32587:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1790964081.780992:0:32587:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:3.0:1790964081.780994:0:32587:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000f7a458b5. 00000100:00000200:3.0:1790964081.780996:0:32587:0:(niobuf.c:94:ptl_send_buf()) Sending 328 bytes to portal 26, xid 1877961927036672, offset 0 00000400:00000200:3.0:1790964081.781000:0:32587:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:3.0:1790964081.781013:0:32587:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:3.0:1790964081.781022:0:32587:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 328 into portal 26 MB=0x6abff15900f00 00000400:00000200:3.0:1790964081.781027:0:32587:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-0@lo of length 328/328 into md 0x165 [2] + 0 00000400:00000010:3.0:1790964081.781031:0:32587:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 000000004b0094e5. 00000400:00000200:3.0:1790964081.781036:0:32587:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 000000007a63f9ff 00000400:00000200:3.0:1790964081.781049:0:32587:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1790964081.781054:0:32587:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:3.0:1790964081.781058:0:32587:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000007a63f9ff 00000400:00000010:3.0:1790964081.781060:0:32587:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at 000000007a63f9ff. 00000100:00000001:3.0:1790964081.781064:0:32587:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:3.0:1790964081.781066:0:32587:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 00000100:00000040:3.0:1790964081.781069:0:32587:0:(events.c:341:request_in_callback()) incoming req@000000008557ba39 x1877961927036672 msgsize 328 00000100:00100000:3.0:1790964081.781072:0:32587:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1790964081.781074:0:32587:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000001:3.0:1790964081.781091:0:32587:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:3.0:1790964081.781097:0:32587:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000f7a458b5 00000400:00000010:3.0:1790964081.781098:0:32587:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000f7a458b5. 00000100:00000001:3.0:1790964081.781101:0:32587:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:3.0:1790964081.781104:0:32587:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@000000009592a7ec x1877961927036672/t0(0) o101->MGC192.168.201.147@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964097 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964081.781113:0:32587:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964081.781116:0:32587:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 2 req@000000009592a7ec x1877961927036672/t0(0) o101->MGC192.168.201.147@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964097 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964081.781122:0:32587:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964081.781124:0:32587:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:3.0:1790964081.781129:0:32587:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964081.781133:0:32587:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS new deadline estimation for cpu 0 is 4295610884 00000100:00000010:3.0:1790964081.781136:0:32587:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 0000000061b02b2b. 00000100:00000001:3.0:1790964081.781142:0:32587:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS request now active for cpu 0 00000100:00000001:3.0:1790964081.781153:0:32587:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS new deadline estimation for cpu 1 is 4295610884 00000100:00000010:3.0:1790964081.781156:0:32587:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000625dddd5. 00000100:00000001:3.0:1790964081.781159:0:32587:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS request now active for cpu 1 00000100:00000001:3.0:1790964081.781170:0:32587:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS new deadline estimation for cpu 2 is 4295610884 00000100:00000010:3.0:1790964081.781174:0:32587:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 000000000605a0f8. 00000100:00000001:3.0:1790964081.781176:0:32587:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS request now active for cpu 2 00000100:00000001:3.0:1790964081.781185:0:32587:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS new deadline estimation for cpu 3 is 4295610884 00000100:00000010:3.0:1790964081.781187:0:32587:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 0000000069dd338c. 00000100:00000001:3.0:1790964081.781190:0:32587:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS request now active for cpu 3 00000100:00000001:3.0:1790964081.781199:0:32587:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1790964081.781201:0:32587:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964081.781203:0:32587:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964081.781204:0:32587:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00100000:3.0:1790964081.781206:0:32587:0:(client.c:2716:ptlrpc_set_wait()) set 000000001167c2c3 going to sleep for 11 seconds 00000100:00000001:3.0:1790964081.781208:0:32587:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964081.781210:0:32587:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964081.781429:0:32585:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:0.0:1790964081.781433:0:32585:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927036672 02000000:00000001:0.0:1790964081.781435:0:32585:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:0.0:1790964081.781437:0:32585:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1790964081.781439:0:32585:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964081.781443:0:32585:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1790964081.781446:0:32585:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927036672 00000020:00000001:0.0:1790964081.781449:0:32585:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:0.0:1790964081.781450:0:32585:0:(genops.c:804:class_conn2export()) looking for export cookie 0x6a601b0c127d5079 00000020:00000001:0.0:1790964081.781453:0:32585:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:0.0:1790964081.781455:0:32585:0:(lustre_handles.c:148:class_handle2object()) GET export 000000002ab79817 refcount=11 00000020:00000001:0.0:1790964081.781457:0:32585:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446629652579706880 : -114421129844736 : ffff97ef41336800) 00000020:00000001:0.0:1790964081.781459:0:32585:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446629652579706880 : -114421129844736 : ffff97ef41336800) 00000100:00000001:0.0:1790964081.781464:0:32585:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:0.0:1790964081.781469:0:32585:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 000000003220375e. 00000100:00000001:0.0:1790964081.781472:0:32585:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:0.0:1790964081.781475:0:32585:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 000000003220375e. 00000020:00000010:0.0:1790964081.781502:0:32585:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000aee95b79. 00000020:00000010:0.0:1790964081.781508:0:32585:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 00000000e31b79ef. 00000020:00000010:0.0:1790964081.781513:0:32585:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 00000000bd668636. 00000100:00000040:0.0:1790964081.781521:0:32585:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000001:0.0:1790964081.781524:0:32585:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:0.0:1790964081.781532:0:32585:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:0.0:1790964081.781533:0:32585:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964081.781541:0:32585:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964081.781556:0:32585:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964081.781566:0:32585:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:0.0:1790964081.781567:0:32585:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:0.0:1790964081.781571:0:32585:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00000040:0.0:1790964081.781575:0:32585:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 000000002ab79817 : new rpc_count 1 00000100:00000001:0.0:1790964081.781577:0:32585:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446629656979049552 : -114416730502064 : ffff97f0476c0c50) 00000100:00000040:0.0:1790964081.781581:0:32585:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@000000008557ba39 x1877961927036672/t0(0) o101->e5c322e7-c837-4fbe-89d7-d887ea2ad81f@0@lo:657/0 lens 328/0 e 0 to 0 dl 1790964092 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964081.781590:0:32585:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:0.0:1790964081.781592:0:32585:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 000000003220375e. 00000100:00000001:0.0:1790964081.781593:0:32585:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:0.0:1790964081.781595:0:32585:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 000000003220375e. 00000100:00100000:0.0:1790964081.781598:0:32585:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008557ba39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+11:32587:x1877961927036672:12345-0@lo:101: 00000100:00000200:0.0:1790964081.781602:0:32585:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877961927036672 00000020:00000001:0.0:1790964081.781604:0:32585:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:0.0:1790964081.781608:0:32585:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:0.0:1790964081.781610:0:32585:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964081.781612:0:32585:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:0.0:1790964081.781614:0:32585:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072667842688 : -1041708928 : ffffffffc1e8c880) 00000020:00000001:0.0:1790964081.781617:0:32585:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:0.0:1790964081.781618:0:32585:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:0.0:1790964081.781620:0:32585:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:0.0:1790964081.781622:0:32585:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:0.0:1790964081.781625:0:32585:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964081.781627:0:32585:0:(tgt_handler.c:1471:tgt_enqueue()) Process entered 00010000:00000001:0.0:1790964081.781629:0:32585:0:(ldlm_lockd.c:1263:ldlm_handle_enqueue()) Process entered 00010000:00010000:0.0:1790964081.781630:0:32585:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00000001:0.0:1790964081.781632:0:32585:0:(ldlm_lockd.c:1725:ldlm_request_cancel()) Process entered 00010000:00000001:0.0:1790964081.781633:0:32585:0:(ldlm_lockd.c:1734:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964081.781637:0:32585:0:(ldlm_lock.c:1700:ldlm_lock_create()) Process entered 00010000:00000010:0.0:1790964081.781647:0:32585:0:(ldlm_resource.c:1510:ldlm_resource_new()) slab-alloced 'res': 256 at 0000000005d4a7db. 00010000:00000001:0.0:1790964081.781650:0:32585:0:(ldlm_lock.c:433:ldlm_lock_new()) Process entered 00010000:00000010:0.0:1790964081.781652:0:32585:0:(ldlm_lock.c:437:ldlm_lock_new()) slab-alloced 'lock': 512 at 00000000394983c6. 00000020:00000001:0.0:1790964081.781655:0:32585:0:(lustre_handles.c:61:class_handle_hash()) Process entered 00000020:00000040:0.0:1790964081.781657:0:32585:0:(lustre_handles.c:93:class_handle_hash()) added object 00000000394983c6 with handle 0x6a601b0c127d5167 to hash 00000020:00000001:0.0:1790964081.781659:0:32585:0:(lustre_handles.c:94:class_handle_hash()) Process leaving 00010000:00000001:0.0:1790964081.781660:0:32585:0:(ldlm_lock.c:488:ldlm_lock_new()) Process leaving (rc=18446629657671797248 : -114416037754368 : ffff97f070b68a00) 00010000:00000001:0.0:1790964081.781662:0:32585:0:(ldlm_lock.c:1741:ldlm_lock_create()) Process leaving (rc=18446629657671797248 : -114416037754368 : ffff97f070b68a00) 00010000:00010000:0.0:1790964081.781664:0:32585:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000394983c6/0x6a601b0c127d5167 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x6a601b0c127d5160 expref: -99 pid: 32585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000040:0.0:1790964081.781671:0:32585:0:(ldlm_lockd.c:1373:ldlm_handle_enqueue()) lock GETting export 000000002ab79817 : new locks_count 6 00000020:00000040:0.0:1790964081.781673:0:32585:0:(genops.c:868:class_export_get()) GET export 000000002ab79817 refcount=12 00000100:00000001:0.0:1790964081.781680:0:32585:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:0.0:1790964081.781682:0:32585:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:0.0:1790964081.781685:0:32585:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 640 at 00000000b704243f. 02000000:00000001:0.0:1790964081.781687:0:32585:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964081.781689:0:32585:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964081.781691:0:32585:0:(ldlm_lock.c:1795:ldlm_lock_enqueue()) Process entered 00010000:00000001:0.0:1790964081.781694:0:32585:0:(ldlm_lock.c:1758:ldlm_lock_enqueue_helper()) Process entered 00010000:00000001:0.0:1790964081.781696:0:32585:0:(ldlm_plain.c:119:ldlm_process_plain_lock()) Process entered 00010000:00000001:0.0:1790964081.781698:0:32585:0:(ldlm_plain.c:54:ldlm_plain_compat_queue()) Process entered 00010000:00000001:0.0:1790964081.781699:0:32585:0:(ldlm_plain.c:99:ldlm_plain_compat_queue()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:0.0:1790964081.781701:0:32585:0:(ldlm_plain.c:54:ldlm_plain_compat_queue()) Process entered 00010000:00000001:0.0:1790964081.781702:0:32585:0:(ldlm_plain.c:99:ldlm_plain_compat_queue()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:0.0:1790964081.781703:0:32585:0:(ldlm_lock.c:1125:ldlm_grant_lock()) Process entered 00010000:00000001:0.0:1790964081.781705:0:32585:0:(ldlm_lock.c:989:search_granted_lock()) Process entered 00010000:00000001:0.0:1790964081.781707:0:32585:0:(ldlm_lock.c:1055:search_granted_lock()) Process leaving 00010000:00000001:0.0:1790964081.781708:0:32585:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) Process entered 00010000:00000040:0.0:1790964081.781710:0:32585:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (0000000005d4a7db) refcount = 1 00010000:00010000:0.0:1790964081.781713:0:32585:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000394983c6/0x6a601b0c127d5167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x6a601b0c127d5160 expref: 12 pid: 32585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:0.0:1790964081.781731:0:32585:0:(ldlm_lock.c:1094:ldlm_granted_list_add_lock()) Process leaving 00010000:00000001:0.0:1790964081.781733:0:32585:0:(ldlm_lock.c:1157:ldlm_grant_lock()) Process leaving 00010000:00000001:0.0:1790964081.781739:0:32585:0:(ldlm_plain.c:146:ldlm_process_plain_lock()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:0.0:1790964081.781741:0:32585:0:(ldlm_lock.c:1769:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964081.781742:0:32585:0:(ldlm_lock.c:1928:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0) 00010000:00000001:0.0:1790964081.781747:0:32585:0:(ldlm_lockd.c:1494:ldlm_handle_enqueue()) Process leaving 00010000:00010000:0.0:1790964081.781749:0:32585:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000394983c6/0x6a601b0c127d5167 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x6a601b0c127d5160 expref: 12 pid: 32585 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:0.0:1790964081.781756:0:32585:0:(ldlm_lock.c:2393:__ldlm_reprocess_all()) Process entered 00010000:00000001:0.0:1790964081.781758:0:32585:0:(ldlm_lock.c:1970:ldlm_reprocess_queue()) Process entered 00010000:00000001:0.0:1790964081.781759:0:32585:0:(ldlm_lock.c:2019:ldlm_reprocess_queue()) Process leaving (rc=1 : 1 : 1) 00010000:00000001:0.0:1790964081.781761:0:32585:0:(ldlm_lock.c:2323:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964081.781763:0:32585:0:(ldlm_lock.c:2427:__ldlm_reprocess_all()) Process leaving 00010000:00000001:0.0:1790964081.781765:0:32585:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:0.0:1790964081.781767:0:32585:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00010000:0.0:1790964081.781768:0:32585:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000394983c6, rc 0) 00000020:00000001:0.0:1790964081.781770:0:32585:0:(tgt_handler.c:1496:tgt_enqueue()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:0.0:1790964081.781773:0:32585:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877961927036672 00010000:00000001:0.0:1790964081.781775:0:32585:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:0.0:1790964081.781778:0:32585:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@000000008557ba39 x1877961927036672/t0(0) o101->e5c322e7-c837-4fbe-89d7-d887ea2ad81f@0@lo:657/0 lens 328/344 e 0 to 0 dl 1790964092 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:0.0:1790964081.781786:0:32585:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:0.0:1790964081.781788:0:32585:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1790964081.781791:0:32585:0:(import.c:2195:obd_at_measure()) add 1 to 0000000015821819 time=8 v=5 (1 0 0 0) 00000100:00000001:0.0:1790964081.781795:0:32585:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:0.0:1790964081.781797:0:32585:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000ae02bb19 refcount 17 to 0@lo 00000100:00000001:0.0:1790964081.781800:0:32585:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446629656951528384 : -114416758023232 : ffff97f045c81bc0) 02000000:00000001:0.0:1790964081.781803:0:32585:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:0.0:1790964081.781805:0:32585:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964081.781807:0:32585:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1790964081.781809:0:32585:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:0.0:1790964081.781812:0:32585:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000e334cc40. 00000100:00000200:0.0:1790964081.781817:0:32585:0:(niobuf.c:94:ptl_send_buf()) Sending 344 bytes to portal 25, xid 1877961927036672, offset 224 00000400:00000200:0.0:1790964081.781821:0:32585:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:0.0:1790964081.781827:0:32585:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:0.0:1790964081.781833:0:32585:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 344 into portal 25 MB=0x6abff15900f00 00000400:00000200:0.0:1790964081.781842:0:32585:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-0@lo of length 344/344 into md 0xac5 [1] + 224 00000400:00000200:0.0:1790964081.781847:0:32585:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1790964081.781850:0:32585:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:0.0:1790964081.781854:0:32585:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:0.0:1790964081.781857:0:32585:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@000000009592a7ec x1877961927036672/t0(0) o101->MGC192.168.201.147@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964097 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1790964081.781876:0:32585:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=344 offset=224 replen=344 req@000000009592a7ec x1877961927036672/t0(0) o101->MGC192.168.201.147@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964097 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964081.781895:0:32585:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:0.0:1790964081.781901:0:32585:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000e334cc40 00000400:00000010:0.0:1790964081.781903:0:32585:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000e334cc40. 00000100:00000001:0.0:1790964081.781906:0:32585:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:0.0:1790964081.781907:0:32585:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:0.0:1790964081.781911:0:32585:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964081.781913:0:32585:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000ae02bb19 refcount 16 to 0@lo 00010000:00000001:0.0:1790964081.781915:0:32585:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:0.0:1790964081.781917:0:32585:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964081.781918:0:32585:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:0.0:1790964081.781921:0:32585:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000008557ba39 x1877961927036672/t0(0) o101->e5c322e7-c837-4fbe-89d7-d887ea2ad81f@0@lo:657/0 lens 328/344 e 0 to 0 dl 1790964092 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964081.781929:0:32585:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008557ba39 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+12:32587:x1877961927036672:12345-0@lo:101: Request processed in 338us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1790964081.781934:0:32585:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00000040:0.0:1790964081.781937:0:32585:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002ab79817 : new rpc_count 0 00000100:00000001:0.0:1790964081.781939:0:32585:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:0.0:1790964081.781940:0:32585:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:0.0:1790964081.781944:0:32585:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 00000000e31b79ef. 00000020:00000010:0.0:1790964081.781947:0:32585:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 00000000bd668636. 00000020:00000010:0.0:1790964081.781949:0:32585:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000aee95b79. 00000020:00000040:0.0:1790964081.781953:0:32585:0:(genops.c:879:class_export_put()) PUTting export 000000002ab79817 : new refcount 11 02000000:00000001:0.0:1790964081.781957:0:32585:0:(sec.c:2614:sptlrpc_svc_free_rs()) Process entered 02000000:00000010:0.0:1790964081.781958:0:32585:0:(sec_null.c:332:null_free_rs()) kvfree 'rs': 640 at 00000000b704243f. 02000000:00000001:0.0:1790964081.781968:0:32585:0:(sec.c:2627:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:0.0:1790964081.781970:0:32585:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:0.0:1790964081.781974:0:32585:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000400:00000010:0.0:1790964081.781978:0:32585:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000fd128481. 00000400:00000010:0.0:1790964081.781983:0:32585:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at 000000006f3f3751. 00000100:00000001:3.0:1790964081.782170:0:32587:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1790964081.782175:0:32587:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1790964081.782177:0:32587:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1790964081.782179:0:32587:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000bae4f811. 00000400:00000200:3.0:1790964081.782182:0:32587:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 0000000093a4317c 00000400:00000010:3.0:1790964081.782184:0:32587:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 0000000093a4317c. 00000100:00000001:3.0:1790964081.782186:0:32587:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1790964081.782189:0:32587:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@000000009592a7ec x1877961927036672/t0(0) o101->MGC192.168.201.147@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964097 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1790964081.782197:0:32587:0:(events.c:104:reply_in_callback()) @@@ unlink req@000000009592a7ec x1877961927036672/t0(0) o101->MGC192.168.201.147@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964097 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964081.782203:0:32587:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:3.0:1790964081.782204:0:32587:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964081.782206:0:32587:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:3.0:1790964081.782209:0:32587:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1790964081.782210:0:32587:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1790964081.782212:0:32587:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964081.782214:0:32587:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1790964081.782218:0:32587:0:(import.c:2195:obd_at_measure()) add 5 to 000000000b342ca4 time=8 v=5 (5 0 0 0) 00000100:00001000:3.0:1790964081.782221:0:32587:0:(import.c:2195:obd_at_measure()) add 1 to 0000000065e52807 time=8 v=5 (1 0 0 0) 00000100:00000001:3.0:1790964081.782224:0:32587:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1790964081.782225:0:32587:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964081.782227:0:32587:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1790964081.782229:0:32587:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964081.782232:0:32587:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964081.782235:0:32587:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@000000009592a7ec x1877961927036672/t0(0) o101->MGC192.168.201.147@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964097 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964081.782243:0:32587:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1790964081.782245:0:32587:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1790964081.782253:0:32587:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1790964081.782257:0:32587:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000009592a7ec x1877961927036672/t0(0) o101->MGC192.168.201.147@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964097 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790964081.782264:0:32587:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009592a7ec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32587:1877961927036672:0@lo:101: 00000100:00000001:3.0:1790964081.782268:0:32587:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964081.782270:0:32587:0:(client.c:2780:ptlrpc_set_wait()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964081.782272:0:32587:0:(client.c:1237:ptlrpc_set_destroy()) Process entered 00000100:00000001:3.0:1790964081.782274:0:32587:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964081.782276:0:32587:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@000000009592a7ec x1877961927036672/t0(0) o101->MGC192.168.201.147@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964097 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964081.782282:0:32587:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:3.0:1790964081.782284:0:32587:0:(client.c:3802:ptlrpc_reqset_free()) kfreed 'set': 144 at 000000001167c2c3. 00000100:00000001:3.0:1790964081.782287:0:32587:0:(client.c:1274:ptlrpc_set_destroy()) Process leaving 00000100:00000001:3.0:1790964081.782288:0:32587:0:(client.c:3372:ptlrpc_queue_wait()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964081.782291:0:32587:0:(ldlm_request.c:661:ldlm_cli_enqueue_fini()) Process entered 00010000:00000001:3.0:1790964081.782293:0:32587:0:(ldlm_lock.c:612:__ldlm_handle2lock()) Process entered 00000020:00000001:3.0:1790964081.782295:0:32587:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1790964081.782296:0:32587:0:(lustre_handles.c:148:class_handle2object()) GET ldlm 0000000065206fdc refcount=4 00000020:00000001:3.0:1790964081.782298:0:32587:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446629657950518272 : -114415759033344 : ffff97f081537c00) 00010000:00000001:3.0:1790964081.782301:0:32587:0:(ldlm_lock.c:634:__ldlm_handle2lock()) Process leaving (rc=18446629657950518272 : -114415759033344 : ffff97f081537c00) 00010000:00000040:3.0:1790964081.782304:0:32587:0:(ldlm_request.c:746:ldlm_cli_enqueue_fini()) local: 0000000065206fdc, remote cookie: 0x6a601b0c127d5167, flags: 0x0 00010000:00000001:3.0:1790964081.782307:0:32587:0:(ldlm_lock.c:1795:ldlm_lock_enqueue()) Process entered 00010000:00000001:3.0:1790964081.782309:0:32587:0:(ldlm_lock.c:1125:ldlm_grant_lock()) Process entered 00010000:00000001:3.0:1790964081.782310:0:32587:0:(ldlm_lock.c:989:search_granted_lock()) Process entered 00010000:00000001:3.0:1790964081.782311:0:32587:0:(ldlm_lock.c:1055:search_granted_lock()) Process leaving 00010000:00000001:3.0:1790964081.782311:0:32587:0:(ldlm_lock.c:1067:ldlm_granted_list_add_lock()) Process entered 00010000:00000040:3.0:1790964081.782313:0:32587:0:(ldlm_resource.c:1876:ldlm_resource_dump()) --- Resource: [0x65727473756c:0x2:0x0].0x0 (00000000b92e1a43) refcount = 1 00010000:00010000:3.0:1790964081.782315:0:32587:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.147@tcp lock: 0000000065206fdc/0x6a601b0c127d5160 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6a601b0c127d5167 expref: -99 pid: 32587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:3.0:1790964081.782322:0:32587:0:(ldlm_lock.c:1094:ldlm_granted_list_add_lock()) Process leaving 00010000:00000001:3.0:1790964081.782323:0:32587:0:(ldlm_lock.c:1157:ldlm_grant_lock()) Process leaving 00010000:00000001:3.0:1790964081.782324:0:32587:0:(ldlm_lock.c:1914:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0) 00010000:00000001:3.0:1790964081.782332:0:32587:0:(ldlm_request.c:286:ldlm_completion_ast()) Process entered 00010000:00000001:3.0:1790964081.782335:0:32587:0:(ldlm_request.c:295:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1790964081.782337:0:32587:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.147@tcp lock: 0000000065206fdc/0x6a601b0c127d5160 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x6a601b0c127d5167 expref: -99 pid: 32587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:3.0:1790964081.782343:0:32587:0:(ldlm_request.c:842:ldlm_cli_enqueue_fini()) Process leaving 00010000:00000001:3.0:1790964081.782355:0:32587:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:3.0:1790964081.782357:0:32587:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:3.0:1790964081.782357:0:32587:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:3.0:1790964081.782358:0:32587:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:3.0:1790964081.782360:0:32587:0:(ldlm_request.c:1218:ldlm_cli_enqueue()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964081.782362:0:32587:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964081.782365:0:32587:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@000000009592a7ec x1877961927036672/t0(0) o101->MGC192.168.201.147@tcp@0@lo:26/25 lens 328/344 e 0 to 0 dl 1790964097 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964081.782372:0:32587:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1790964081.782374:0:32587:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1790964081.782376:0:32587:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000003c7dbbaf. 02000000:00000001:3.0:1790964081.782379:0:32587:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1790964081.782381:0:32587:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:3.0:1790964081.782383:0:32587:0:(genops.c:1223:class_import_put()) import 00000000f7398c40 refcount=3 obd=MGC192.168.201.147@tcp 00000020:00000001:3.0:1790964081.782385:0:32587:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:3.0:1790964081.782387:0:32587:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at 000000000078407d. 02000000:00000001:3.0:1790964081.782391:0:32587:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1790964081.782393:0:32587:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1790964081.782394:0:32587:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 000000009592a7ec. 00000100:00000001:3.0:1790964081.782397:0:32587:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1790964081.782398:0:32587:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 10000000:00000001:3.0:1790964081.782400:0:32587:0:(mgc_request.c:1023:mgc_enqueue()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:3.0:1790964081.782403:0:32587:0:(mgc_request.c:105:config_log_get()) Process entered 10000000:00000040:3.0:1790964081.782405:0:32587:0:(mgc_request.c:108:config_log_get()) log lustre-mdtir (000000003d127acf) refs 3 10000000:00000001:3.0:1790964081.782406:0:32587:0:(mgc_request.c:109:config_log_get()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964081.782408:0:32587:0:(ldlm_lock.c:612:__ldlm_handle2lock()) Process entered 00000020:00000001:3.0:1790964081.782410:0:32587:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1790964081.782411:0:32587:0:(lustre_handles.c:148:class_handle2object()) GET ldlm 0000000065206fdc refcount=3 00000020:00000001:3.0:1790964081.782413:0:32587:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446629657950518272 : -114415759033344 : ffff97f081537c00) 00010000:00000001:3.0:1790964081.782415:0:32587:0:(ldlm_lock.c:634:__ldlm_handle2lock()) Process leaving (rc=18446629657950518272 : -114415759033344 : ffff97f081537c00) 00010000:00000001:3.0:1790964081.782417:0:32587:0:(ldlm_lock.c:2547:ldlm_lock_set_data()) Process entered 00010000:00000001:3.0:1790964081.782423:0:32587:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:3.0:1790964081.782425:0:32587:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00000001:3.0:1790964081.782426:0:32587:0:(ldlm_lock.c:2556:ldlm_lock_set_data()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:3.0:1790964081.782429:0:32587:0:(mgc_request.c:1520:mgc_process_recover_log()) Process entered 10000000:00000010:3.0:1790964081.782431:0:32587:0:(mgc_request.c:1532:mgc_process_recover_log()) kmalloced '(folios)': 32 at 00000000fd87e0cd. 00000100:00000010:3.0:1790964081.782446:0:32587:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 000000009592a7ec. 00000020:00000040:3.0:1790964081.782449:0:32587:0:(genops.c:1210:class_import_get()) import 00000000f7398c40 refcount=4 obd=MGC192.168.201.147@tcp 00000100:00000001:3.0:1790964081.782452:0:32587:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:3.0:1790964081.782454:0:32587:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:3.0:1790964081.782459:0:32587:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:3.0:1790964081.782463:0:32587:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at 000000000078407d. 00000100:00000001:3.0:1790964081.782467:0:32587:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964081.782471:0:32587:0:(client.c:227:ptlrpc_prep_bulk_imp()) Process entered 00000100:00000010:3.0:1790964081.782473:0:32587:0:(client.c:169:ptlrpc_new_bulk()) kmalloced '(desc)': 984 at 000000003c7dbbaf. 00000100:00000010:3.0:1790964081.782476:0:32587:0:(client.c:174:ptlrpc_new_bulk()) kmalloced '(desc->bd_vec)': 64 at 0000000087bdfec3. 00000020:00000040:3.0:1790964081.782478:0:32587:0:(genops.c:1210:class_import_get()) import 00000000f7398c40 refcount=5 obd=MGC192.168.201.147@tcp 00000100:00000001:3.0:1790964081.782501:0:32587:0:(client.c:3353:ptlrpc_queue_wait()) Process entered 00000100:00000001:3.0:1790964081.782503:0:32587:0:(client.c:1169:ptlrpc_prep_set()) Process entered 00000100:00000010:3.0:1790964081.782507:0:32587:0:(client.c:1171:ptlrpc_prep_set()) kmalloced '(set)': 144 at 000000001167c2c3. 00000100:00000001:3.0:1790964081.782509:0:32587:0:(client.c:1186:ptlrpc_prep_set()) Process leaving (rc=18446629657338854592 : -114416370697024 : ffff97f05cde3cc0) 00000100:00000001:3.0:1790964081.782511:0:32587:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1790964081.782512:0:32587:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446629657911025536 : -114415798526080 : ffff97f07ef8df80) 00000100:00000001:3.0:1790964081.782515:0:32587:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:3.0:1790964081.782518:0:32587:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964081.782519:0:32587:0:(client.c:2689:ptlrpc_set_wait()) Process entered 00000100:00000001:3.0:1790964081.782520:0:32587:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:3.0:1790964081.782523:0:32587:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@000000009592a7ec x1877961927036800/t0(0) o256->MGC192.168.201.147@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 0 ref 2 fl New:QU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964081.782529:0:32587:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:3.0:1790964081.782531:0:32587:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964081.782533:0:32587:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:3.0:1790964081.782535:0:32587:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:3.0:1790964081.782537:0:32587:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:3.0:1790964081.782540:0:32587:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000009592a7ec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32587:1877961927036800:0@lo:256: 00000100:00000001:3.0:1790964081.782543:0:32587:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:3.0:1790964081.782552:0:32587:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:3.0:1790964081.782554:0:32587:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964081.782556:0:32587:0:(niobuf.c:346:ptlrpc_register_bulk()) Process entered 00000400:00000010:3.0:1790964081.782560:0:32587:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000bae4f811. 00000400:00000010:3.0:1790964081.782564:0:32587:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 184 at 00000000b13a20f1. 00000100:00000200:3.0:1790964081.782567:0:32587:0:(niobuf.c:453:ptlrpc_register_bulk()) Setup 1 bulk put-sink buffers: 4 pages 16384 bytes, mbits x0x6abff15900f80-0x6abff15900f80, portal 33 00000100:00000001:3.0:1790964081.782570:0:32587:0:(niobuf.c:455:ptlrpc_register_bulk()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964081.782572:0:32587:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:3.0:1790964081.782576:0:32587:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 000000000068298e. 02000000:00000001:3.0:1790964081.782578:0:32587:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:3.0:1790964081.782580:0:32587:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000b3c1f400. 00000400:00000010:3.0:1790964081.782583:0:32587:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 0000000093a4317c. 00000100:00000200:3.0:1790964081.782585:0:32587:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1877961927036800, portal 25 00000100:00000001:3.0:1790964081.782586:0:32587:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:3.0:1790964081.782587:0:32587:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446629657911025536 : -114415798526080 : ffff97f07ef8df80) 00000100:00000040:3.0:1790964081.782591:0:32587:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@000000009592a7ec x1877961927036800/t0(0) o256->MGC192.168.201.147@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964097 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964081.782597:0:32587:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:3.0:1790964081.782599:0:32587:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:3.0:1790964081.782601:0:32587:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000f7a458b5. 00000100:00000200:3.0:1790964081.782603:0:32587:0:(niobuf.c:94:ptl_send_buf()) Sending 304 bytes to portal 26, xid 1877961927036800, offset 0 00000400:00000200:3.0:1790964081.782607:0:32587:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:3.0:1790964081.782613:0:32587:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:3.0:1790964081.782619:0:32587:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 304 into portal 26 MB=0x6abff15900f80 00000400:00000200:3.0:1790964081.782623:0:32587:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-0@lo of length 304/304 into md 0x169 [2] + 0 00000400:00000010:3.0:1790964081.782626:0:32587:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 0000000055edb6c4. 00000400:00000200:3.0:1790964081.782629:0:32587:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 000000009d9c73b8 00000400:00000200:3.0:1790964081.782633:0:32587:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:3.0:1790964081.782636:0:32587:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:3.0:1790964081.782639:0:32587:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000009d9c73b8 00000400:00000010:3.0:1790964081.782641:0:32587:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at 000000009d9c73b8. 00000100:00000001:3.0:1790964081.782644:0:32587:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:3.0:1790964081.782645:0:32587:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 00000100:00000040:3.0:1790964081.782648:0:32587:0:(events.c:341:request_in_callback()) incoming req@0000000055b45684 x1877961927036800 msgsize 304 00000100:00100000:3.0:1790964081.782657:0:32587:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:3.0:1790964081.782658:0:32587:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000001:3.0:1790964081.782672:0:32587:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:3.0:1790964081.782677:0:32587:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000f7a458b5 00000400:00000010:3.0:1790964081.782678:0:32587:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000f7a458b5. 00000100:00000001:3.0:1790964081.782680:0:32587:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:3.0:1790964081.782681:0:32587:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@000000009592a7ec x1877961927036800/t0(0) o256->MGC192.168.201.147@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964097 ref 3 fl Rpc:r/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964081.782686:0:32587:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964081.782687:0:32587:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 2 req@000000009592a7ec x1877961927036800/t0(0) o256->MGC192.168.201.147@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964097 ref 3 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964081.782691:0:32587:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964081.782692:0:32587:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:3.0:1790964081.782694:0:32587:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964081.782696:0:32587:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS new deadline estimation for cpu 0 is 4295610886 00000100:00000001:3.0:1790964081.782700:0:32587:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS request active for cpu 0, simply extend its deadline from 4295610884 00000100:00000001:3.0:1790964081.782704:0:32587:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS new deadline estimation for cpu 1 is 4295610886 00000100:00000001:3.0:1790964081.782706:0:32587:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS request active for cpu 1, simply extend its deadline from 4295610884 00000100:00000001:3.0:1790964081.782708:0:32587:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS new deadline estimation for cpu 2 is 4295610886 00000100:00000001:3.0:1790964081.782709:0:32587:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS request active for cpu 2, simply extend its deadline from 4295610884 00000100:00000001:3.0:1790964081.782710:0:32587:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS new deadline estimation for cpu 3 is 4295610886 00000100:00000001:3.0:1790964081.782711:0:32587:0:(niobuf.c:685:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS request active for cpu 3, simply extend its deadline from 4295610884 00000100:00000001:3.0:1790964081.782713:0:32587:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:3.0:1790964081.782714:0:32587:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964081.782715:0:32587:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:3.0:1790964081.782716:0:32587:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00100000:3.0:1790964081.782718:0:32587:0:(client.c:2716:ptlrpc_set_wait()) set 000000001167c2c3 going to sleep for 11 seconds 00000100:00000001:3.0:1790964081.782762:0:32587:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:3.0:1790964081.782763:0:32587:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964081.782827:0:32584:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:2.0:1790964081.782829:0:32584:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927036800 02000000:00000001:2.0:1790964081.782830:0:32584:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:2.0:1790964081.782831:0:32584:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1790964081.782833:0:32584:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964081.782835:0:32584:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964081.782837:0:32584:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927036800 00000020:00000001:2.0:1790964081.782838:0:32584:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:2.0:1790964081.782839:0:32584:0:(genops.c:804:class_conn2export()) looking for export cookie 0x6a601b0c127d5079 00000020:00000001:2.0:1790964081.782841:0:32584:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:2.0:1790964081.782842:0:32584:0:(lustre_handles.c:148:class_handle2object()) GET export 000000002ab79817 refcount=12 00000020:00000001:2.0:1790964081.782843:0:32584:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446629652579706880 : -114421129844736 : ffff97ef41336800) 00000020:00000001:2.0:1790964081.782845:0:32584:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446629652579706880 : -114421129844736 : ffff97ef41336800) 00000100:00000001:2.0:1790964081.782847:0:32584:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:2.0:1790964081.782850:0:32584:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000240fc48c. 00000100:00000001:2.0:1790964081.782851:0:32584:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:2.0:1790964081.782852:0:32584:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000240fc48c. 00000020:00000010:2.0:1790964081.782855:0:32584:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000fc61378e. 00000020:00000010:2.0:1790964081.782862:0:32584:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 0000000096dd4ab6. 00000020:00000010:2.0:1790964081.782864:0:32584:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 0000000054bf6c75. 00000100:00000040:2.0:1790964081.782869:0:32584:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000001:2.0:1790964081.782871:0:32584:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:2.0:1790964081.782872:0:32584:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:2.0:1790964081.782873:0:32584:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964081.782877:0:32584:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964081.782887:0:32584:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964081.782892:0:32584:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:2.0:1790964081.782893:0:32584:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:2.0:1790964081.782895:0:32584:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00000040:2.0:1790964081.782897:0:32584:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 000000002ab79817 : new rpc_count 1 00000100:00000001:2.0:1790964081.782898:0:32584:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446629656979047504 : -114416730504112 : ffff97f0476c0450) 00000100:00000040:2.0:1790964081.782901:0:32584:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@0000000055b45684 x1877961927036800/t0(0) o256->e5c322e7-c837-4fbe-89d7-d887ea2ad81f@0@lo:657/0 lens 304/0 e 0 to 0 dl 1790964092 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964081.782905:0:32584:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:2.0:1790964081.782907:0:32584:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 00000000240fc48c. 00000100:00000001:2.0:1790964081.782908:0:32584:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:2.0:1790964081.782909:0:32584:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 00000000240fc48c. 00000100:00100000:2.0:1790964081.782911:0:32584:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055b45684 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+12:32587:x1877961927036800:12345-0@lo:256: 00000100:00000200:2.0:1790964081.782914:0:32584:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877961927036800 00000020:00000001:2.0:1790964081.782915:0:32584:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:2.0:1790964081.782917:0:32584:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:2.0:1790964081.782918:0:32584:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964081.782919:0:32584:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:2.0:1790964081.782920:0:32584:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072667843104 : -1041708512 : ffffffffc1e8ca20) 00000020:00000001:2.0:1790964081.782922:0:32584:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:2.0:1790964081.782923:0:32584:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:2.0:1790964081.782924:0:32584:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:2.0:1790964081.782925:0:32584:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:2.0:1790964081.782927:0:32584:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964081.782928:0:32584:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:2.0:1790964081.782929:0:32584:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:2.0:1790964081.782934:0:32584:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 536 at 00000000c2bbe584. 02000000:00000001:2.0:1790964081.782936:0:32584:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964081.782937:0:32584:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 20000000:00000001:2.0:1790964081.782939:0:32584:0:(mgs_handler.c:690:mgs_config_read()) Process entered 20000000:00000001:2.0:1790964081.782942:0:32584:0:(mgs_nids.c:889:mgs_get_ir_logs()) Process entered 20000000:01000000:2.0:1790964081.782945:0:32584:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:00000010:2.0:1790964081.782947:0:32584:0:(mgs_nids.c:917:mgs_get_ir_logs()) kmalloced '(folios)': 32 at 00000000c3cfa034. 20000000:00000001:2.0:1790964081.782949:0:32584:0:(mgs_nids.c:188:mgs_nidtbl_read()) Process entered 20000000:00000040:2.0:1790964081.782955:0:32584:0:(mgs_nids.c:144:nidtbl_fill_entry()) IR: 1 NIDs from NET #0 20000000:01000000:2.0:1790964081.782960:0:32584:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1790964081.782962:0:32584:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 20000000:00000001:2.0:1790964081.782963:0:32584:0:(mgs_nids.c:321:mgs_nidtbl_read()) Process leaving (rc=44 : 44 : 2c) 00000100:00000001:2.0:1790964081.782965:0:32584:0:(niobuf.c:145:ptlrpc_prep_bulk_exp()) Process entered 00000100:00000010:2.0:1790964081.782967:0:32584:0:(client.c:169:ptlrpc_new_bulk()) kmalloced '(desc)': 984 at 0000000040019fb6. 00000100:00000010:2.0:1790964081.782969:0:32584:0:(client.c:174:ptlrpc_new_bulk()) kmalloced '(desc->bd_vec)': 16 at 00000000e185a698. 00000020:00000040:2.0:1790964081.782970:0:32584:0:(genops.c:868:class_export_get()) GET export 000000002ab79817 refcount=13 00010000:00000001:2.0:1790964081.782972:0:32584:0:(ldlm_lib.c:3582:target_bulk_io()) Process entered 00000100:00000001:2.0:1790964081.782974:0:32584:0:(niobuf.c:184:ptlrpc_start_bulk_transfer()) Process entered 00000400:00000010:2.0:1790964081.782976:0:32584:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000b18255f0. 00000400:00000010:2.0:1790964081.782981:0:32584:0:(lib-lnet.h:449:lnet_rspt_alloc()) alloc 'rspt': 64 at 0000000041bef49b. 00000400:00000200:2.0:1790964081.782982:0:32584:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:2.0:1790964081.782987:0:32584:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:2.0:1790964081.782991:0:32584:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 44 into portal 33 MB=0x6abff15900f80 00000400:00000200:2.0:1790964081.782993:0:32584:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 21 from 12345-0@lo of length 44/44 into md 0xad5 [4] + 0 00000400:00000010:2.0:1790964081.782995:0:32584:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000bae4f811. 00000400:00000200:2.0:1790964081.782997:0:32584:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 00000000b13a20f1 00000400:00000200:2.0:1790964081.782999:0:32584:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1790964081.783001:0:32584:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:2.0:1790964081.783003:0:32584:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000b13a20f1 00000400:00000010:2.0:1790964081.783004:0:32584:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 184 at 00000000b13a20f1. 00000100:00000001:2.0:1790964081.783006:0:32584:0:(events.c:177:client_bulk_callback()) Process entered 00000100:00000200:2.0:1790964081.783007:0:32584:0:(events.c:195:client_bulk_callback()) event type 2, status 0, req 000000009592a7ec desc 000000003c7dbbaf mbits 1877961927036800 00000100:00000001:2.0:1790964081.783017:0:32584:0:(events.c:220:client_bulk_callback()) Process leaving 00000400:00000200:2.0:1790964081.783019:0:32584:0:(lib-md.c:96:lnet_cpt_of_md()) Couldn't resolve first page of md 0000000000000000 with offset 0 00000400:00000200:2.0:1790964081.783022:0:32584:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : ACK - for me 00000400:00000200:2.0:1790964081.783026:0:32584:0:(lib-move.c:4532:lnet_parse_ack()) 0@lo: ACK from 12345-0@lo into md 0xae1 00000400:00000200:2.0:1790964081.783031:0:32584:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1790964081.783033:0:32584:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: ACK: OK 00000100:00000001:2.0:1790964081.783035:0:32584:0:(events.c:449:server_bulk_callback()) Process entered 00000100:00000200:2.0:1790964081.783036:0:32584:0:(events.c:464:server_bulk_callback()) event type 4, status 0, desc 0000000040019fb6 00000100:00000001:2.0:1790964081.783037:0:32584:0:(events.c:491:server_bulk_callback()) Process leaving 00000400:00000200:2.0:1790964081.783041:0:32584:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000b18255f0 00000400:00000010:2.0:1790964081.783042:0:32584:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000b18255f0. 00000100:00000001:2.0:1790964081.783044:0:32584:0:(events.c:449:server_bulk_callback()) Process entered 00000100:00000200:2.0:1790964081.783044:0:32584:0:(events.c:464:server_bulk_callback()) event type 5, status 0, desc 0000000040019fb6 00000100:00000001:2.0:1790964081.783045:0:32584:0:(events.c:491:server_bulk_callback()) Process leaving 00000100:00000200:2.0:1790964081.783048:0:32584:0:(niobuf.c:279:ptlrpc_start_bulk_transfer()) Transferring 1 pages 44 bytes via portal 33 id 12345-0@lo mbits 0x6abff15900f80-0x6abff15900f80 00000100:00000001:2.0:1790964081.783050:0:32584:0:(niobuf.c:281:ptlrpc_start_bulk_transfer()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964081.783052:0:32584:0:(ldlm_lib.c:3674:target_bulk_io()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964081.783053:0:32584:0:(client.c:325:ptlrpc_free_bulk()) Process entered 00000020:00000040:2.0:1790964081.783055:0:32584:0:(genops.c:879:class_export_put()) PUTting export 000000002ab79817 : new refcount 12 00000100:00000010:2.0:1790964081.783057:0:32584:0:(client.c:346:ptlrpc_free_bulk()) kvfree 'desc->bd_vec': 16 at 00000000e185a698. 00000100:00000010:2.0:1790964081.783059:0:32584:0:(client.c:347:ptlrpc_free_bulk()) kfreed 'desc': 984 at 0000000040019fb6. 00000100:00000001:2.0:1790964081.783060:0:32584:0:(client.c:348:ptlrpc_free_bulk()) Process leaving 20000000:00000001:2.0:1790964081.783061:0:32584:0:(mgs_nids.c:953:mgs_get_ir_logs()) Process leaving via out (rc=0 : 0 : 0x0) 20000000:00000010:2.0:1790964081.783067:0:32584:0:(mgs_nids.c:964:mgs_get_ir_logs()) kvfree 'folios': 32 at 00000000c3cfa034. 20000000:00000001:2.0:1790964081.783070:0:32584:0:(mgs_handler.c:713:mgs_config_read()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:2.0:1790964081.783073:0:32584:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877961927036800 00010000:00000001:2.0:1790964081.783074:0:32584:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:2.0:1790964081.783076:0:32584:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@0000000055b45684 x1877961927036800/t0(0) o256->e5c322e7-c837-4fbe-89d7-d887ea2ad81f@0@lo:657/0 lens 304/240 e 0 to 0 dl 1790964092 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1790964081.783081:0:32584:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:2.0:1790964081.783082:0:32584:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1790964081.783084:0:32584:0:(import.c:2195:obd_at_measure()) add 1 to 0000000015821819 time=8 v=5 (1 0 0 0) 00000100:00000001:2.0:1790964081.783086:0:32584:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:2.0:1790964081.783087:0:32584:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000ae02bb19 refcount 17 to 0@lo 00000100:00000001:2.0:1790964081.783088:0:32584:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446629656951528384 : -114416758023232 : ffff97f045c81bc0) 02000000:00000001:2.0:1790964081.783090:0:32584:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:2.0:1790964081.783091:0:32584:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964081.783092:0:32584:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1790964081.783093:0:32584:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:2.0:1790964081.783097:0:32584:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000b18255f0. 00000100:00000200:2.0:1790964081.783098:0:32584:0:(niobuf.c:94:ptl_send_buf()) Sending 240 bytes to portal 25, xid 1877961927036800, offset 224 00000400:00000200:2.0:1790964081.783101:0:32584:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:2.0:1790964081.783104:0:32584:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:2.0:1790964081.783106:0:32584:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 240 into portal 25 MB=0x6abff15900f80 00000400:00000200:2.0:1790964081.783108:0:32584:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-0@lo of length 240/240 into md 0xad9 [1] + 224 00000400:00000200:2.0:1790964081.783111:0:32584:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1790964081.783112:0:32584:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:2.0:1790964081.783114:0:32584:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:2.0:1790964081.783116:0:32584:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@000000009592a7ec x1877961927036800/t0(0) o256->MGC192.168.201.147@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964097 ref 2 fl Rpc:Qr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:2.0:1790964081.783120:0:32584:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=240 offset=224 replen=240 req@000000009592a7ec x1877961927036800/t0(0) o256->MGC192.168.201.147@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964097 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964081.783125:0:32584:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:2.0:1790964081.783126:0:32584:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000b18255f0 00000400:00000010:2.0:1790964081.783127:0:32584:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000b18255f0. 00000100:00000001:2.0:1790964081.783128:0:32584:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:2.0:1790964081.783129:0:32584:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:2.0:1790964081.783131:0:32584:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964081.783132:0:32584:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000ae02bb19 refcount 16 to 0@lo 00010000:00000001:2.0:1790964081.783133:0:32584:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:2.0:1790964081.783134:0:32584:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:2.0:1790964081.783135:0:32584:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:2.0:1790964081.783137:0:32584:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@0000000055b45684 x1877961927036800/t0(0) o256->e5c322e7-c837-4fbe-89d7-d887ea2ad81f@0@lo:657/0 lens 304/240 e 0 to 0 dl 1790964092 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790964081.783142:0:32584:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055b45684 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+12:32587:x1877961927036800:12345-0@lo:256: Request processed in 236us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1790964081.783147:0:32584:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00000040:2.0:1790964081.783148:0:32584:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002ab79817 : new rpc_count 0 00000100:00000001:2.0:1790964081.783150:0:32584:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:2.0:1790964081.783151:0:32584:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:2.0:1790964081.783154:0:32584:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 0000000096dd4ab6. 00000020:00000010:2.0:1790964081.783156:0:32584:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 0000000054bf6c75. 00000020:00000010:2.0:1790964081.783161:0:32584:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000fc61378e. 00000020:00000040:2.0:1790964081.783164:0:32584:0:(genops.c:879:class_export_put()) PUTting export 000000002ab79817 : new refcount 11 02000000:00000001:2.0:1790964081.783165:0:32584:0:(sec.c:2614:sptlrpc_svc_free_rs()) Process entered 02000000:00000010:2.0:1790964081.783167:0:32584:0:(sec_null.c:332:null_free_rs()) kvfree 'rs': 536 at 00000000c2bbe584. 02000000:00000001:2.0:1790964081.783168:0:32584:0:(sec.c:2627:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:2.0:1790964081.783169:0:32584:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:2.0:1790964081.783172:0:32584:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000400:00000010:2.0:1790964081.783174:0:32584:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000e0d0a645. 00000400:00000010:2.0:1790964081.783178:0:32584:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at 00000000158cab97. 00000100:00000001:3.0:1790964081.783529:0:32587:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:3.0:1790964081.783534:0:32587:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:3.0:1790964081.783536:0:32587:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:3.0:1790964081.783544:0:32587:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000b3c1f400. 00000400:00000200:3.0:1790964081.783547:0:32587:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 0000000093a4317c 00000400:00000010:3.0:1790964081.783549:0:32587:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 0000000093a4317c. 00000100:00000001:3.0:1790964081.783552:0:32587:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:3.0:1790964081.783555:0:32587:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@000000009592a7ec x1877961927036800/t0(0) o256->MGC192.168.201.147@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964097 ref 2 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:3.0:1790964081.783561:0:32587:0:(events.c:104:reply_in_callback()) @@@ unlink req@000000009592a7ec x1877961927036800/t0(0) o256->MGC192.168.201.147@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964097 ref 2 fl Rpc:RQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964081.783567:0:32587:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:3.0:1790964081.783568:0:32587:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964081.783573:0:32587:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:3.0:1790964081.783574:0:32587:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:3.0:1790964081.783576:0:32587:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:3.0:1790964081.783578:0:32587:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:3.0:1790964081.783580:0:32587:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:3.0:1790964081.783583:0:32587:0:(import.c:2195:obd_at_measure()) add 5 to 000000000b342ca4 time=8 v=5 (5 0 0 0) 00000100:00001000:3.0:1790964081.783586:0:32587:0:(import.c:2195:obd_at_measure()) add 1 to 0000000065e52807 time=8 v=5 (1 0 0 0) 00000100:00000001:3.0:1790964081.783588:0:32587:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:3.0:1790964081.783589:0:32587:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:3.0:1790964081.783591:0:32587:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:3.0:1790964081.783593:0:32587:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964081.783595:0:32587:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964081.783597:0:32587:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Bulk req@000000009592a7ec x1877961927036800/t0(0) o256->MGC192.168.201.147@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964097 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:3.0:1790964081.783605:0:32587:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Bulk to Interpret req@000000009592a7ec x1877961927036800/t0(0) o256->MGC192.168.201.147@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964097 ref 2 fl Bulk:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964081.783610:0:32587:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:3.0:1790964081.783611:0:32587:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:3.0:1790964081.783614:0:32587:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000009592a7ec x1877961927036800/t0(0) o256->MGC192.168.201.147@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964097 ref 2 fl Interpret:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1790964081.783621:0:32587:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000009592a7ec pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:32587:1877961927036800:0@lo:256: 00000100:00000001:3.0:1790964081.783625:0:32587:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:3.0:1790964081.783627:0:32587:0:(client.c:2780:ptlrpc_set_wait()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964081.783635:0:32587:0:(client.c:1237:ptlrpc_set_destroy()) Process entered 00000100:00000001:3.0:1790964081.783637:0:32587:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964081.783639:0:32587:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@000000009592a7ec x1877961927036800/t0(0) o256->MGC192.168.201.147@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964097 ref 2 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964081.783645:0:32587:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:3.0:1790964081.783647:0:32587:0:(client.c:3802:ptlrpc_reqset_free()) kfreed 'set': 144 at 000000001167c2c3. 00000100:00000001:3.0:1790964081.783649:0:32587:0:(client.c:1274:ptlrpc_set_destroy()) Process leaving 00000100:00000001:3.0:1790964081.783650:0:32587:0:(client.c:3372:ptlrpc_queue_wait()) Process leaving (rc=0 : 0 : 0) 10000000:00000040:3.0:1790964081.783653:0:32587:0:(mgc_request.c:1600:mgc_process_recover_log()) Latest version 9, more 0. 10000000:00000001:3.0:1790964081.783657:0:32587:0:(mgc_request.c:1308:mgc_apply_recover_logs()) Process entered 10000000:00000010:3.0:1790964081.783663:0:32587:0:(mgc_request.c:1331:mgc_apply_recover_logs()) kmalloced '(nidlist)': 640 at 00000000ddbeee5c. 10000000:00000010:3.0:1790964081.783666:0:32587:0:(mgc_request.c:1343:mgc_apply_recover_logs()) kmalloced '(obdname)': 128 at 00000000ecdae2e7. 10000000:00000200:3.0:1790964081.783671:0:32587:0:(mgc_request.c:1241:mgc_build_nidlist()) use 1 from 1 NIDs 10000000:00000040:3.0:1790964081.783674:0:32587:0:(mgc_request.c:1440:mgc_apply_recover_logs()) Looking for OBD lustre-MDT0000-mdc-MDT0000 10000000:00000040:3.0:1790964081.783681:0:32587:0:(mgc_request.c:1445:mgc_apply_recover_logs()) MGC192.168.201.147@tcp: cannot find OBD lustre-MDT0000-mdc-MDT0000 10000000:00000010:3.0:1790964081.783683:0:32587:0:(mgc_request.c:1492:mgc_apply_recover_logs()) kfreed 'obdname': 128 at 00000000ecdae2e7. 10000000:00000010:3.0:1790964081.783687:0:32587:0:(mgc_request.c:1494:mgc_apply_recover_logs()) kfreed 'nidlist': 640 at 00000000ddbeee5c. 10000000:00000001:3.0:1790964081.783689:0:32587:0:(mgc_request.c:1496:mgc_apply_recover_logs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:3.0:1790964081.783692:0:32587:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:3.0:1790964081.783693:0:32587:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@000000009592a7ec x1877961927036800/t0(0) o256->MGC192.168.201.147@tcp@0@lo:26/25 lens 304/240 e 0 to 0 dl 1790964097 ref 1 fl Complete:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:3.0:1790964081.783699:0:32587:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:3.0:1790964081.783701:0:32587:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:3.0:1790964081.783703:0:32587:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 000000000068298e. 02000000:00000001:3.0:1790964081.783705:0:32587:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:3.0:1790964081.783707:0:32587:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:3.0:1790964081.783708:0:32587:0:(genops.c:1223:class_import_put()) import 00000000f7398c40 refcount=4 obd=MGC192.168.201.147@tcp 00000020:00000001:3.0:1790964081.783710:0:32587:0:(genops.c:1230:class_import_put()) Process leaving 00000100:00000001:3.0:1790964081.783711:0:32587:0:(client.c:325:ptlrpc_free_bulk()) Process entered 00000020:00000001:3.0:1790964081.783713:0:32587:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:3.0:1790964081.783713:0:32587:0:(genops.c:1223:class_import_put()) import 00000000f7398c40 refcount=3 obd=MGC192.168.201.147@tcp 00000020:00000001:3.0:1790964081.783715:0:32587:0:(genops.c:1230:class_import_put()) Process leaving 00000100:00000010:3.0:1790964081.783716:0:32587:0:(client.c:346:ptlrpc_free_bulk()) kvfree 'desc->bd_vec': 64 at 0000000087bdfec3. 00000100:00000010:3.0:1790964081.783799:0:32587:0:(client.c:347:ptlrpc_free_bulk()) kfreed 'desc': 984 at 000000003c7dbbaf. 00000100:00000001:3.0:1790964081.783802:0:32587:0:(client.c:348:ptlrpc_free_bulk()) Process leaving 02000000:00000010:3.0:1790964081.783808:0:32587:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 512 at 000000000078407d. 02000000:00000001:3.0:1790964081.783811:0:32587:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:3.0:1790964081.783812:0:32587:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:3.0:1790964081.783813:0:32587:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 000000009592a7ec. 00000100:00000001:3.0:1790964081.783815:0:32587:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:3.0:1790964081.783816:0:32587:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 10000000:00000010:3.0:1790964081.783826:0:32587:0:(mgc_request.c:1652:mgc_process_recover_log()) kvfree 'folios': 32 at 00000000fd87e0cd. 10000000:01000000:3.0:1790964081.783829:0:32587:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.147@tcp: configuration from log 'lustre-mdtir' succeeded (0). 10000000:00000001:3.0:1790964081.783831:0:32587:0:(mgc_request.c:1029:mgc_cancel()) Process entered 00010000:00000001:3.0:1790964081.783832:0:32587:0:(ldlm_lock.c:612:__ldlm_handle2lock()) Process entered 00000020:00000001:3.0:1790964081.783834:0:32587:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:3.0:1790964081.783835:0:32587:0:(lustre_handles.c:148:class_handle2object()) GET ldlm 0000000065206fdc refcount=3 00000020:00000001:3.0:1790964081.783836:0:32587:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446629657950518272 : -114415759033344 : ffff97f081537c00) 00010000:00000001:3.0:1790964081.783838:0:32587:0:(ldlm_lock.c:634:__ldlm_handle2lock()) Process leaving (rc=18446629657950518272 : -114415759033344 : ffff97f081537c00) 00010000:00000001:3.0:1790964081.783840:0:32587:0:(ldlm_lock.c:854:ldlm_lock_decref_internal()) Process entered 00010000:00010000:3.0:1790964081.783842:0:32587:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.147@tcp lock: 0000000065206fdc/0x6a601b0c127d5160 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6a601b0c127d5167 expref: -99 pid: 32587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:3.0:1790964081.783847:0:32587:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:3.0:1790964081.783848:0:32587:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 00010000:00010000:3.0:1790964081.783849:0:32587:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.147@tcp lock: 0000000065206fdc/0x6a601b0c127d5160 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x6a601b0c127d5167 expref: -99 pid: 32587 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00000001:3.0:1790964081.783860:0:32587:0:(ldlm_lock.c:923:ldlm_lock_decref_internal()) Process leaving 00010000:00000001:3.0:1790964081.783861:0:32587:0:(ldlm_lock.c:185:ldlm_lock_put()) Process entered 00010000:00000001:3.0:1790964081.783861:0:32587:0:(ldlm_lock.c:224:ldlm_lock_put()) Process leaving 10000000:00000001:3.0:1790964081.783862:0:32587:0:(mgc_request.c:1033:mgc_cancel()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:3.0:1790964081.783863:0:32587:0:(mgc_request.c:1907:mgc_process_log()) Process leaving (rc=0 : 0 : 0) 10000000:00000001:3.0:1790964081.783865:0:32587:0:(mgc_request.c:621:do_requeue()) Process leaving 10000000:00000001:3.0:1790964081.783867:0:32587:0:(mgc_request.c:117:config_log_put()) Process entered 10000000:00000040:3.0:1790964081.783868:0:32587:0:(mgc_request.c:123:config_log_put()) log lustre-mdtir(000000003d127acf) refs 3 10000000:00000001:3.0:1790964081.783870:0:32587:0:(mgc_request.c:147:config_log_put()) Process leaving 00000100:00000040:2.0:1790964081.787631:0:31384:0:(connection.c:75:cpu_latency_work()) work item of 000000002f5f8e48 (cpu 2) has reached its deadline 4295610886, at 4295610887 00000100:00000010:2.0:1790964081.787648:0:31384:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 000000000605a0f8. 00000100:00000040:3.0:1790964081.787811:0:12040:0:(connection.c:75:cpu_latency_work()) work item of 00000000ae8cb54c (cpu 3) has reached its deadline 4295610886, at 4295610887 00000100:00000010:3.0:1790964081.787817:0:12040:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 0000000069dd338c. 00000100:00000040:0.0:1790964081.787891:0:127:0:(connection.c:75:cpu_latency_work()) work item of 0000000021367367 (cpu 0) has reached its deadline 4295610886, at 4295610887 00000100:00000010:0.0:1790964081.787897:0:127:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 0000000061b02b2b. 00000100:00000040:1.0:1790964081.788055:0:3119:0:(connection.c:75:cpu_latency_work()) work item of 000000002146c102 (cpu 1) has reached its deadline 4295610886, at 4295610887 00000100:00000010:1.0:1790964081.788061:0:3119:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000625dddd5. 00010000:00000001:2.0:1790964082.101430:0:31384:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:2.0:1790964082.101440:0:31384:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964082.101448:0:31384:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:2.0:1790964082.101449:0:31384:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964082.102211:0:32578:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1790964082.102229:0:32578:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1790964082.102233:0:32578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000001:2.0:1790964082.550176:0:32628:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:2.0:1790964082.550183:0:32628:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964082.550185:0:32628:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964082.550190:0:32628:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017495dc3 going to sleep for 0 seconds 00000100:00000001:2.0:1790964082.550195:0:32628:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964082.550199:0:32628:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964082.550202:0:32628:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1790964082.550204:0:32628:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964082.550206:0:32628:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00080000:00000001:0.0:1790964082.792723:0:32986:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:0.0:1790964082.792742:0:32986:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964082.792747:0:32986:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964082.806555:0:31726:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:0.0:1790964082.806572:0:31726:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1790964082.806575:0:31726:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964082.806580:0:31726:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964082.806582:0:31726:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1790964082.806586:0:31726:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964082.806588:0:31726:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964083.124595:0:31384:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:2.0:1790964083.124604:0:31384:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964083.124610:0:31384:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:2.0:1790964083.124612:0:31384:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964083.124721:0:32579:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:1.0:1790964083.124724:0:32579:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:1.0:1790964083.124727:0:32579:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000001:3.0:1790964083.218990:0:33022:0:(debug.c:652:libcfs_debug_mark_buffer()) ************************************************** 00000001:02000400:3.0:1790964083.219000:0:33022:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: conf-sanity test_167: @@@@@@ FAIL: mds1 mounted without a remote update llog 00000001:00000001:3.0:1790964083.229421:0:33022:0:(debug.c:655:libcfs_debug_mark_buffer()) ************************************************** 00000100:00000001:0.0:1790964083.588233:0:32628:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:0.0:1790964083.588250:0:32628:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1790964083.588252:0:32628:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1790964083.588257:0:32628:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017495dc3 going to sleep for 0 seconds 00000100:00000001:0.0:1790964083.588262:0:32628:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1790964083.588266:0:32628:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964083.588268:0:32628:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1790964083.588271:0:32628:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964083.588273:0:32628:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964083.829300:0:31726:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:0.0:1790964083.829382:0:31726:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1790964083.829385:0:31726:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964083.829390:0:31726:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964083.829393:0:31726:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1790964083.829397:0:31726:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964083.829399:0:31726:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964084.148613:0:31384:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:2.0:1790964084.148622:0:31384:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964084.148629:0:31384:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:2.0:1790964084.148633:0:31384:0:(ldlm_request.c:2324:ldlm_cancel_lru()) Process entered 00010000:00000001:2.0:1790964084.148636:0:31384:0:(ldlm_request.c:2112:ldlm_prepare_lru_list()) Process entered 00010000:00000001:2.0:1790964084.148639:0:31384:0:(ldlm_request.c:2284:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964084.148642:0:31384:0:(ldlm_lockd.c:2241:ldlm_bl_to_thread()) Process entered 00010000:00000001:2.0:1790964084.148655:0:31384:0:(ldlm_lockd.c:2244:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964084.148657:0:31384:0:(ldlm_request.c:2334:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964084.148678:0:31384:0:(ldlm_pool.c:496:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964084.148939:0:32578:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1790964084.148942:0:32578:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1790964084.148945:0:32578:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000001:0.0:1790964084.596608:0:32628:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:0.0:1790964084.596618:0:32628:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1790964084.596620:0:32628:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1790964084.596624:0:32628:0:(client.c:2716:ptlrpc_set_wait()) set 0000000017495dc3 going to sleep for 0 seconds 00000100:00000001:0.0:1790964084.596628:0:32628:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1790964084.596662:0:32628:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964084.596665:0:32628:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:0.0:1790964084.596667:0:32628:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964084.596670:0:32628:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964084.852611:0:31726:0:(client.c:2568:ptlrpc_expired_set()) Process entered 00000100:00000001:0.0:1790964084.852619:0:31726:0:(client.c:2486:ptlrpc_expire_one_request()) Process entered 00000100:00100000:0.0:1790964084.852630:0:31726:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1790964074/real 1790964074] req@00000000752f663e x1877961927034112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964084 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000400:00000001:0.0:1790964084.852649:0:31726:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1790964084.852652:0:31726:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1790964084.852654:0:31726:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000b95b38fc. 00000400:00000200:0.0:1790964084.852662:0:31726:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 000000008ed2a03d 00000400:00000010:0.0:1790964084.852664:0:31726:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 000000008ed2a03d. 00000100:00000001:0.0:1790964084.852669:0:31726:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:0.0:1790964084.852672:0:31726:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@00000000752f663e x1877961927034112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964084 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1790964084.852680:0:31726:0:(events.c:104:reply_in_callback()) @@@ unlink req@00000000752f663e x1877961927034112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964084 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964084.852687:0:31726:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:0.0:1790964084.852689:0:31726:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964084.852691:0:31726:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1790964084.852693:0:31726:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00100000:0.0:1790964084.852710:0:31726:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@00000000752f663e x1877961927034112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964084 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964084.852717:0:31726:0:(client.c:2540:ptlrpc_expire_one_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964084.852726:0:31726:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1790964084.852728:0:31726:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964084.852730:0:31726:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964084.852733:0:31726:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1790964084.852734:0:31726:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:0.0:1790964084.852737:0:31726:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@00000000752f663e x1877961927034112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964084 ref 1 fl Rpc:EXNQU/200/ffffffff rc -110/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964084.852744:0:31726:0:(client.c:2143:ptlrpc_check_set()) Process leaving via interpret (rc=18446744073709551506 : -110 : 0xffffffffffffff92) 00000100:00000001:0.0:1790964084.852766:0:31726:0:(client.c:2994:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964084.852768:0:31726:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1790964084.852769:0:31726:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964084.852771:0:31726:0:(import.c:1101:ptlrpc_connect_interpret()) Process entered 00000100:00000001:0.0:1790964084.852773:0:31726:0:(import.c:1136:ptlrpc_connect_interpret()) Process leaving via out (rc=18446744073709551506 : -110 : 0xffffffffffffff92) 00000100:00080000:0.0:1790964084.852776:0:31726:0:(import.c:65:import_set_state_nolock()) 00000000a5292057 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790964084.852796:0:31726:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00000001:0.0:1790964084.852798:0:31726:0:(import.c:1561:ptlrpc_connect_interpret()) Process leaving (rc=18446744073709551506 : -110 : ffffffffffffff92) 00000100:00000040:0.0:1790964084.852801:0:31726:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000752f663e x1877961927034112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964084 ref 1 fl Interpret:EXNQU/200/ffffffff rc -110/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964084.852808:0:31726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000752f663e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31726:1877961927034112:0@lo:8: 00000100:00000001:0.0:1790964084.852813:0:31726:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964084.852815:0:31726:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1790964084.852817:0:31726:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@00000000752f663e x1877961927034112/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1790964084 ref 1 fl Complete:EXNQU/200/ffffffff rc -110/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964084.852822:0:31726:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1790964084.852824:0:31726:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1790964084.852828:0:31726:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000d754b935. 02000000:00000001:0.0:1790964084.852832:0:31726:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1790964084.852835:0:31726:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:0.0:1790964084.852837:0:31726:0:(genops.c:1223:class_import_put()) import 00000000a5292057 refcount=2 obd=lustre-OST0000-osc-MDT0000 00000020:00000001:0.0:1790964084.852839:0:31726:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:0.0:1790964084.852842:0:31726:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 1024 at 000000007357c18d. 02000000:00000001:0.0:1790964084.852846:0:31726:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1790964084.852848:0:31726:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1790964084.852849:0:31726:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 00000000752f663e. 00000100:00000001:0.0:1790964084.852853:0:31726:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1790964084.852854:0:31726:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964084.852856:0:31726:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964084.852860:0:31726:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:0.0:1790964084.852861:0:31726:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964084.852862:0:31726:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964084.852863:0:31726:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964084.853156:0:26510:0:(pinger.c:229:ptlrpc_pinger_process_import()) e5c322e7-c837-4fbe-89d7-d887ea2ad81f->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:2.0:1790964084.853162:0:26510:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:2.0:1790964084.853168:0:26510:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 00000000397d6266. 00000020:00000040:2.0:1790964084.853172:0:26510:0:(genops.c:1210:class_import_get()) import 00000000f7398c40 refcount=4 obd=MGC192.168.201.147@tcp 00000100:00000001:2.0:1790964084.853176:0:26510:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1790964084.853179:0:26510:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1790964084.853184:0:26510:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1790964084.853191:0:26510:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000003de5b3a7. 00000100:00000001:2.0:1790964084.853207:0:26510:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964084.853212:0:26510:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging e5c322e7-c837-4fbe-89d7-d887ea2ad81f->MGS req@00000000397d6266 x1877961927036928/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:2.0:1790964084.853223:0:26510:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1790964084.853225:0:26510:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964084.853230:0:26510:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [00000000397d6266] to pc [ptlrpcd_00_03+3] req@00000000397d6266 x1877961927036928/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964084.853266:0:26510:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00080000:2.0:1790964084.853269:0:26510:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1790964084.853272:0:26510:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00000001:2.0:1790964084.853275:0:26510:0:(import.c:745:ptlrpc_connect_import_locked()) Process entered 00000100:00080000:2.0:1790964084.853276:0:26510:0:(import.c:65:import_set_state_nolock()) 00000000a5292057 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00000001:2.0:1790964084.853280:0:26510:0:(import.c:520:import_select_connection()) Process entered 00000100:00080000:2.0:1790964084.853283:0:26510:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 936 00000100:00001000:2.0:1790964084.853288:0:26510:0:(import.c:2195:obd_at_measure()) add 10 to 000000005649ea8e time=1790964084 v=0 (0 0 0 0) 00000100:00001000:2.0:1790964084.853291:0:26510:0:(import.c:2261:obd_at_measure()) AT 000000005649ea8e change: old=0 new=10 delta=10 (val=10) hist 10 0 0 0 00000100:00080000:2.0:1790964084.853302:0:26510:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00000040:2.0:1790964084.853304:0:26510:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000ae02bb19 refcount 15 to 0@lo 00000100:00000001:2.0:1790964084.853307:0:26510:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:2.0:1790964084.853309:0:26510:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000ae02bb19 refcount 16 to 0@lo 00000100:00000001:2.0:1790964084.853310:0:26510:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446629656951528384 : -114416758023232 : ffff97f045c81bc0) 00000020:00000001:2.0:1790964084.853313:0:26510:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:2.0:1790964084.853322:0:26510:0:(genops.c:804:class_conn2export()) looking for export cookie 0x6a601b0c127d50fe 00000020:00000001:2.0:1790964084.853325:0:26510:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:2.0:1790964084.853327:0:26510:0:(lustre_handles.c:148:class_handle2object()) GET export 0000000059898a32 refcount=4 00000020:00000001:2.0:1790964084.853329:0:26510:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446629657881882624 : -114415827668992 : ffff97f07d3c3000) 00000020:00000001:2.0:1790964084.853331:0:26510:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446629657881882624 : -114415827668992 : ffff97f07d3c3000) 00000100:00000040:2.0:1790964084.853334:0:26510:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000ae02bb19 refcount 15 to 0@lo 00000100:00000001:2.0:1790964084.853336:0:26510:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:2.0:1790964084.853338:0:26510:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000ae02bb19 refcount 16 to 0@lo 00000100:00000001:2.0:1790964084.853339:0:26510:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446629656951528384 : -114416758023232 : ffff97f045c81bc0) 00000020:00000040:2.0:1790964084.853342:0:26510:0:(genops.c:879:class_export_put()) PUTting export 0000000059898a32 : new refcount 3 00000100:00080000:2.0:1790964084.853344:0:26510:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import 00000000a5292057 using connection 192.168.201.147@tcp/0@lo 00000100:00000001:2.0:1790964084.853346:0:26510:0:(import.c:672:import_select_connection()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964084.853348:0:26510:0:(sec.c:1579:sptlrpc_import_sec_adapt()) Process entered 02000000:00000001:2.0:1790964084.853355:0:26510:0:(sec.c:1619:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1790964084.853357:0:26510:0:(sec.c:1647:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964084.853360:0:26510:0:(obd_class.h:888:obd_reconnect()) Process entered 00000100:00000001:2.0:1790964084.853362:0:26510:0:(obd_class.h:902:obd_reconnect()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:2.0:1790964084.853367:0:26510:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 0000000016edf9f6. 00000020:00000040:2.0:1790964084.853369:0:26510:0:(genops.c:1210:class_import_get()) import 00000000a5292057 refcount=3 obd=lustre-OST0000-osc-MDT0000 02000000:00000001:2.0:1790964084.853372:0:26510:0:(sec.c:2038:sptlrpc_sepol_get()) Process entered 02000000:00000001:2.0:1790964084.853373:0:26510:0:(sec.c:2048:sptlrpc_sepol_get()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964084.853376:0:26510:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1790964084.853377:0:26510:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1790964084.853379:0:26510:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1790964084.853383:0:26510:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at 0000000040019fb6. 00000100:00000001:2.0:1790964084.853386:0:26510:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964084.853390:0:26510:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000016edf9f6 x1877961927037056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:2.0:1790964084.853397:0:26510:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1790964084.853398:0:26510:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964084.853400:0:26510:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000016edf9f6] to pc [ptlrpcd_rcv+-1] req@0000000016edf9f6 x1877961927037056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964084.853414:0:26510:0:(import.c:877:ptlrpc_connect_import_locked()) Process leaving (rc=0 : 0 : 0) 00000100:00080000:2.0:1790964084.853422:0:26510:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1790964084.853425:0:26510:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00000001:2.0:1790964084.853426:0:26510:0:(import.c:745:ptlrpc_connect_import_locked()) Process entered 00000100:00080000:2.0:1790964084.853428:0:26510:0:(import.c:65:import_set_state_nolock()) 00000000d0c8ccf1 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00000001:2.0:1790964084.853431:0:26510:0:(import.c:520:import_select_connection()) Process entered 00000100:00080000:2.0:1790964084.853432:0:26510:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 936 00000100:00001000:2.0:1790964084.853435:0:26510:0:(import.c:2195:obd_at_measure()) add 10 to 00000000de9532a1 time=10 v=5 (1 0 0 0) 00000100:00001000:2.0:1790964084.853437:0:26510:0:(import.c:2261:obd_at_measure()) AT 00000000de9532a1 change: old=5 new=10 delta=5 (val=10) hist 10 0 0 0 00000100:00080000:2.0:1790964084.853439:0:26510:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00000040:2.0:1790964084.853441:0:26510:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000ae02bb19 refcount 15 to 0@lo 00000100:00000001:2.0:1790964084.853443:0:26510:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:2.0:1790964084.853444:0:26510:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000ae02bb19 refcount 16 to 0@lo 00000100:00000001:2.0:1790964084.853446:0:26510:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446629656951528384 : -114416758023232 : ffff97f045c81bc0) 00000020:00000001:2.0:1790964084.853449:0:26510:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:2.0:1790964084.853450:0:26510:0:(genops.c:804:class_conn2export()) looking for export cookie 0x6a601b0c127d5113 00000020:00000001:2.0:1790964084.853451:0:26510:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:2.0:1790964084.853453:0:26510:0:(lustre_handles.c:148:class_handle2object()) GET export 00000000a5ff7db4 refcount=4 00000020:00000001:2.0:1790964084.853454:0:26510:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446629657846990848 : -114415862560768 : ffff97f07b27c800) 00000020:00000001:2.0:1790964084.853456:0:26510:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446629657846990848 : -114415862560768 : ffff97f07b27c800) 00000100:00000040:2.0:1790964084.853458:0:26510:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000ae02bb19 refcount 15 to 0@lo 00000100:00000001:2.0:1790964084.853459:0:26510:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:2.0:1790964084.853460:0:26510:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000ae02bb19 refcount 16 to 0@lo 00000100:00000001:2.0:1790964084.853462:0:26510:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446629656951528384 : -114416758023232 : ffff97f045c81bc0) 00000020:00000040:2.0:1790964084.853463:0:26510:0:(genops.c:879:class_export_put()) PUTting export 00000000a5ff7db4 : new refcount 3 00000100:00080000:2.0:1790964084.853465:0:26510:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 00000000d0c8ccf1 using connection 192.168.201.147@tcp/0@lo 00000100:00000001:2.0:1790964084.853467:0:26510:0:(import.c:672:import_select_connection()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964084.853469:0:26510:0:(sec.c:1579:sptlrpc_import_sec_adapt()) Process entered 02000000:00000001:2.0:1790964084.853471:0:26510:0:(sec.c:1619:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1790964084.853473:0:26510:0:(sec.c:1647:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964084.853475:0:26510:0:(obd_class.h:888:obd_reconnect()) Process entered 00000100:00000001:2.0:1790964084.853476:0:26510:0:(obd_class.h:902:obd_reconnect()) Process leaving (rc=0 : 0 : 0) 00000100:00000010:2.0:1790964084.853504:0:26510:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 0000000027c66538. 00000020:00000040:2.0:1790964084.853507:0:26510:0:(genops.c:1210:class_import_get()) import 00000000d0c8ccf1 refcount=4 obd=lustre-MDT0001-osp-MDT0000 02000000:00000001:2.0:1790964084.853509:0:26510:0:(sec.c:2038:sptlrpc_sepol_get()) Process entered 02000000:00000001:2.0:1790964084.853510:0:26510:0:(sec.c:2048:sptlrpc_sepol_get()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964084.853511:0:26510:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1790964084.853513:0:26510:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1790964084.853515:0:26510:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1790964084.853518:0:26510:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 1024 at 00000000c73348d2. 00000100:00000001:2.0:1790964084.853521:0:26510:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964084.853525:0:26510:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000027c66538 x1877961927037184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:2.0:1790964084.853531:0:26510:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1790964084.853533:0:26510:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964084.853535:0:26510:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [0000000027c66538] to pc [ptlrpcd_rcv+-1] req@0000000027c66538 x1877961927037184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964084.853542:0:26510:0:(import.c:877:ptlrpc_connect_import_locked()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964084.853544:0:26510:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00000001:2.0:1790964084.853547:0:26510:0:(pinger.c:119:ptlrpc_ping()) Process entered 00000100:00000010:2.0:1790964084.853549:0:26510:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 000000002fc40658. 00000020:00000040:2.0:1790964084.853551:0:26510:0:(genops.c:1210:class_import_get()) import 000000007c9fe86f refcount=3 obd=lustre-MDT0000-lwp-MDT0000 00000100:00000001:2.0:1790964084.853552:0:26510:0:(client.c:858:ptlrpc_request_bufs_pack()) Process entered 02000000:00000001:2.0:1790964084.853554:0:26510:0:(sec.c:433:sptlrpc_req_get_ctx()) Process entered 02000000:00000001:2.0:1790964084.853555:0:26510:0:(sec.c:457:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0) 02000000:00000010:2.0:1790964084.853557:0:26510:0:(sec_null.c:146:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000064b124cf. 00000100:00000001:2.0:1790964084.853560:0:26510:0:(client.c:938:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964084.853562:0:26510:0:(pinger.c:133:ptlrpc_ping()) @@@ pinging lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID req@000000002fc40658 x1877961927037312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00000001:2.0:1790964084.853568:0:26510:0:(jobid.c:959:lustre_get_jobid()) Process entered 00000100:00000001:2.0:1790964084.853569:0:26510:0:(jobid.c:970:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964084.853571:0:26510:0:(ptlrpcd.c:235:ptlrpcd_add_req()) @@@ add req [000000002fc40658] to pc [ptlrpcd_00_00+0] req@000000002fc40658 x1877961927037312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964084.853588:0:26510:0:(pinger.c:142:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964084.853598:0:26510:0:(pinger.c:304:ptlrpc_pinger_main()) next wakeup in 5 (951) 00000100:00000001:2.0:1790964084.853610:0:31727:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964084.853612:0:31727:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:2.0:1790964084.853614:0:31727:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:2.0:1790964084.853618:0:31727:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@000000002fc40658 x1877961927037312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964084.853625:0:31727:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:2.0:1790964084.853627:0:31727:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964084.853631:0:31727:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:2.0:1790964084.853633:0:31727:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:2.0:1790964084.853635:0:31727:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:2.0:1790964084.853637:0:31727:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002fc40658 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:31727:1877961927037312:0@lo:400: 00000100:00000001:2.0:1790964084.853642:0:31727:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:2.0:1790964084.853646:0:31727:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:2.0:1790964084.853648:0:31727:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964084.853651:0:31727:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:2.0:1790964084.853655:0:31727:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 0000000097d312e9. 02000000:00000001:2.0:1790964084.853657:0:31727:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:2.0:1790964084.853663:0:31727:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 000000002bce9eb1. 00000400:00000010:2.0:1790964084.853669:0:31727:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000b18255f0. 00000100:00000200:2.0:1790964084.853675:0:31727:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1877961927037312, portal 10 00000100:00000001:2.0:1790964084.853677:0:31727:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:2.0:1790964084.853678:0:31727:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446629657336982912 : -114416372568704 : ffff97f05cc1ad80) 00000100:00000040:2.0:1790964084.853684:0:31727:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@000000002fc40658 x1877961927037312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964100 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964084.853691:0:31727:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:2.0:1790964084.853694:0:31727:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000100:00000001:1.0:1790964084.853879:0:31729:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00100000:1.0:1790964084.853884:0:31729:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00000001:1.0:1790964084.853886:0:31729:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964084.853890:0:31729:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964084.853892:0:31729:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964084.853893:0:31729:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964084.853894:0:31729:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964084.853902:0:31729:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1790964084.853905:0:31729:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@00000000397d6266 x1877961927036928/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964084.853912:0:31729:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1790964084.853913:0:31729:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964084.853915:0:31729:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1790964084.853917:0:31729:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1790964084.853919:0:31729:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964084.853921:0:31729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000397d6266 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:31729:1877961927036928:0@lo:400: 00000100:00000001:1.0:1790964084.853924:0:31729:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1790964084.853939:0:31729:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1790964084.853940:0:31729:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964084.853941:0:31729:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1790964084.853944:0:31729:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 00000000992a79f3. 02000000:00000001:1.0:1790964084.853946:0:31729:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1790964084.853950:0:31729:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000d797ccbd. 00000400:00000010:1.0:1790964084.853954:0:31729:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000de759e7f. 00000100:00000200:1.0:1790964084.853956:0:31729:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1877961927036928, portal 25 00000100:00000001:1.0:1790964084.853958:0:31729:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1790964084.853958:0:31729:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446629657336975744 : -114416372575872 : ffff97f05cc19180) 00000100:00000040:1.0:1790964084.853961:0:31729:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@00000000397d6266 x1877961927036928/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964100 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964084.853967:0:31729:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964084.853968:0:31729:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964084.853971:0:31729:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000c7f8b6d1. 00000100:00000200:1.0:1790964084.853973:0:31729:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1877961927036928, offset 0 00000400:00000200:1.0:1790964084.853978:0:31729:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964084.853992:0:31729:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964084.854003:0:31729:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 26 MB=0x6abff15901000 00000400:00000200:1.0:1790964084.854067:0:31729:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 1a from 12345-0@lo of length 224/224 into md 0x16d [2] + 0 00000400:00000010:1.0:1790964084.854071:0:31729:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000f8a5c8fb. 00000400:00000200:1.0:1790964084.854076:0:31729:0:(lib-md.c:42:lnet_md_unlink()) Queueing unlink of md 00000000007757d0 00000400:00000200:1.0:1790964084.854084:0:31729:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964084.854093:0:31729:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000400:00000200:1.0:1790964084.854100:0:31729:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000007757d0 00000400:00000010:1.0:1790964084.854102:0:31729:0:(lib-lnet.h:286:lnet_md_free()) kfreed 'md': 152 at 00000000007757d0. 00000100:00000001:1.0:1790964084.854106:0:31729:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:1.0:1790964084.854108:0:31729:0:(events.c:300:request_in_callback()) event type 2, status 0, service mgs 00000100:00000040:1.0:1790964084.854110:0:31729:0:(events.c:341:request_in_callback()) incoming req@00000000a30ac6fe x1877961927036928 msgsize 224 00000100:00100000:1.0:1790964084.854114:0:31729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000040:1.0:1790964084.854115:0:31729:0:(events.c:353:request_in_callback()) Buffer complete: 63 buffers still posted 00000100:00000001:1.0:1790964084.854125:0:31729:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:1.0:1790964084.854133:0:31729:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000c7f8b6d1 00000400:00000010:1.0:1790964084.854134:0:31729:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000c7f8b6d1. 00000100:00000001:1.0:1790964084.854137:0:31729:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:1.0:1790964084.854139:0:31729:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@00000000397d6266 x1877961927036928/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964100 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964084.854147:0:31729:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964084.854149:0:31729:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@00000000397d6266 x1877961927036928/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964100 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964084.854155:0:31729:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964084.854156:0:31729:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:1.0:1790964084.854161:0:31729:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964084.854165:0:31729:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS new deadline estimation for cpu 0 is 4295613957 00000100:00000010:1.0:1790964084.854168:0:31729:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 000000007d2d5880. 00000100:00000001:1.0:1790964084.854174:0:31729:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS request now active for cpu 0 00000100:00000001:1.0:1790964084.854185:0:31729:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS new deadline estimation for cpu 1 is 4295613957 00000100:00000010:1.0:1790964084.854188:0:31729:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 0000000090e506c1. 00000100:00000001:1.0:1790964084.854191:0:31729:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS request now active for cpu 1 00000100:00000001:1.0:1790964084.854203:0:31729:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS new deadline estimation for cpu 2 is 4295613957 00000100:00000010:1.0:1790964084.854206:0:31729:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000910ccaab. 00000100:00000001:1.0:1790964084.854209:0:31729:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS request now active for cpu 2 00000100:00000001:1.0:1790964084.854211:0:31729:0:(niobuf.c:663:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS new deadline estimation for cpu 3 is 4295613957 00000100:00000010:1.0:1790964084.854213:0:31729:0:(niobuf.c:666:kick_cpu_latency()) kmalloced '(latency_qos->pm_qos_req)': 72 at 00000000a7f6c55e. 00000100:00000001:1.0:1790964084.854216:0:31729:0:(niobuf.c:678:kick_cpu_latency()) MGC192.168.201.147@tcp: PM QoS request now active for cpu 3 00000100:00000001:1.0:1790964084.854227:0:31729:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1790964084.854230:0:31729:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964084.854232:0:31729:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964084.854234:0:31729:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964084.854262:0:31728:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964084.854264:0:31728:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964084.854269:0:31726:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964084.854271:0:31726:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964084.854272:0:31726:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1790964084.854275:0:31726:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@0000000016edf9f6 x1877961927037056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964084.854282:0:31726:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1790964084.854283:0:31726:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964084.854285:0:31726:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1790964084.854286:0:31726:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1790964084.854287:0:31726:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964084.854289:0:31726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000016edf9f6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31726:1877961927037056:0@lo:8: 00000100:00000001:1.0:1790964084.854303:0:31726:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1790964084.854305:0:31726:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1790964084.854306:0:31726:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964084.854308:0:31726:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1790964084.854311:0:31726:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000ce850a56. 02000000:00000001:1.0:1790964084.854313:0:31726:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1790964084.854316:0:31726:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000d8b29204. 00000400:00000010:1.0:1790964084.854318:0:31726:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000c7f8b6d1. 00000100:00000200:1.0:1790964084.854321:0:31726:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1877961927037056, portal 4 00000100:00000001:1.0:1790964084.854323:0:31726:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1790964084.854324:0:31726:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446629657336979328 : -114416372572288 : ffff97f05cc19f80) 00000020:00000010:1.0:1790964084.854330:0:31726:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 000000007d271b04. 00000100:00000040:1.0:1790964084.854335:0:31726:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@0000000016edf9f6 x1877961927037056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1790964099 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964084.854340:0:31726:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964084.854342:0:31726:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964084.854344:0:31726:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000077be555. 00000100:00000200:1.0:1790964084.854352:0:31726:0:(niobuf.c:94:ptl_send_buf()) Sending 520 bytes to portal 28, xid 1877961927037056, offset 0 00000400:00000200:1.0:1790964084.854356:0:31726:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964084.854361:0:31726:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964084.854366:0:31726:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 520 into portal 28 MB=0x6abff15901080 00000400:00000100:1.0:1790964084.854370:0:31726:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1877961927037056 offset 0 length 520: 4 00000400:00000200:1.0:1790964084.854373:0:31726:0:(lib-msg.c:1116:lnet_is_health_check()) Msg 00000000b1ec76df is in inconsistent state, don't perform health checking (-2, 0) 00000400:00000200:1.0:1790964084.854375:0:31726:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 0, status = -2, hstatus = 0 00000400:00000200:1.0:1790964084.854380:0:31726:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000077be555 00000400:00000010:1.0:1790964084.854382:0:31726:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000077be555. 00000100:00000001:1.0:1790964084.854384:0:31726:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:1.0:1790964084.854387:0:31726:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@0000000016edf9f6 x1877961927037056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1790964099 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964084.854393:0:31726:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964084.854395:0:31726:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@0000000016edf9f6 x1877961927037056/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 1790964099 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964084.854400:0:31726:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964084.854401:0:31726:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:1.0:1790964084.854404:0:31726:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964084.854407:0:31726:0:(niobuf.c:635:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: using a timeout of 0 usecs (0 jiffies) 00000100:00000001:1.0:1790964084.854409:0:31726:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 0 is 4295613957 00000100:00000001:1.0:1790964084.854411:0:31726:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request active for cpu 0, keep current deadline 4295613957 00000100:00000001:1.0:1790964084.854413:0:31726:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 1 is 4295613957 00000100:00000001:1.0:1790964084.854414:0:31726:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request active for cpu 1, keep current deadline 4295613957 00000100:00000001:1.0:1790964084.854415:0:31726:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 2 is 4295613957 00000100:00000001:1.0:1790964084.854417:0:31726:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request active for cpu 2, keep current deadline 4295613957 00000100:00000001:1.0:1790964084.854418:0:31726:0:(niobuf.c:663:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS new deadline estimation for cpu 3 is 4295613957 00000100:00000001:1.0:1790964084.854420:0:31726:0:(niobuf.c:692:kick_cpu_latency()) lustre-OST0000-osc-MDT0000: PM QoS request active for cpu 3, keep current deadline 4295613957 00000100:00000001:1.0:1790964084.854421:0:31726:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1790964084.854423:0:31726:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964084.854425:0:31726:0:(client.c:1814:ptlrpc_send_new_req()) Process entered 00000100:00000040:1.0:1790964084.854433:0:31726:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc req@0000000027c66538 x1877961927037184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964084.854439:0:31726:0:(client.c:1377:ptlrpc_import_delay_req()) Process entered 00000100:00000001:1.0:1790964084.854440:0:31726:0:(client.c:1436:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964084.854442:0:31726:0:(sec.c:709:sptlrpc_req_refresh_ctx()) Process entered 02000000:00000001:1.0:1790964084.854443:0:31726:0:(sec.c:740:sptlrpc_req_refresh_ctx()) Process leaving via out_sec_put (rc=0 : 0 : 0x0) 02000000:00000001:1.0:1790964084.854445:0:31726:0:(sec.c:784:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964084.854447:0:31726:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000027c66538 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31726:1877961927037184:0@lo:38: 00000100:00000001:1.0:1790964084.854450:0:31726:0:(niobuf.c:866:ptl_send_rpc()) Process entered 02000000:00000001:1.0:1790964084.854451:0:31726:0:(sec.c:1080:sptlrpc_cli_wrap_request()) Process entered 02000000:00000001:1.0:1790964084.854453:0:31726:0:(sec.c:1117:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964084.854454:0:31726:0:(sec.c:1855:sptlrpc_cli_alloc_repbuf()) Process entered 02000000:00000010:1.0:1790964084.854458:0:31726:0:(sec_null.c:189:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000ce48b43d. 02000000:00000001:1.0:1790964084.854459:0:31726:0:(sec.c:1865:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0) 00000400:00000010:1.0:1790964084.854461:0:31726:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000809aaa59. 00000400:00000010:1.0:1790964084.854464:0:31726:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000077be555. 00000100:00000200:1.0:1790964084.854467:0:31726:0:(niobuf.c:1097:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1877961927037184, portal 4 00000100:00000001:1.0:1790964084.854469:0:31726:0:(client.c:3276:ptlrpc_request_addref()) Process entered 00000100:00000001:1.0:1790964084.854470:0:31726:0:(client.c:3278:ptlrpc_request_addref()) Process leaving (rc=18446629657336984704 : -114416372566912 : ffff97f05cc1b480) 00000020:00000010:1.0:1790964084.854509:0:31726:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 0000000047e42164. 00000100:00000040:1.0:1790964084.854515:0:31726:0:(niobuf.c:1117:ptl_send_rpc()) @@@ send flags=200 req@0000000027c66538 x1877961927037184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964099 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964084.854521:0:31726:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964084.854523:0:31726:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964084.854525:0:31726:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000ed11b0a3. 00000100:00000200:1.0:1790964084.854528:0:31726:0:(niobuf.c:94:ptl_send_buf()) Sending 520 bytes to portal 24, xid 1877961927037184, offset 0 00000400:00000200:1.0:1790964084.854531:0:31726:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964084.854537:0:31726:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964084.854541:0:31726:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 520 into portal 24 MB=0x6abff15901100 00000400:00000200:1.0:1790964084.854547:0:31726:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 18 from 12345-0@lo of length 520/520 into md 0x429 [256] + 520 00000400:00000200:1.0:1790964084.854571:0:31726:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964084.854574:0:31726:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:1.0:1790964084.854578:0:31726:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:1.0:1790964084.854584:0:31726:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt_out 00000100:00000010:1.0:1790964084.854587:0:31726:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 0000000046ea57fa. 00000100:00000040:1.0:1790964084.854590:0:31726:0:(events.c:341:request_in_callback()) incoming req@0000000046ea57fa x1877961927037184 msgsize 520 00000100:00100000:1.0:1790964084.854593:0:31726:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000001:1.0:1790964084.854600:0:31726:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:1.0:1790964084.854604:0:31726:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000ed11b0a3 00000400:00000010:1.0:1790964084.854606:0:31726:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000ed11b0a3. 00000100:00000001:1.0:1790964084.854608:0:31726:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:1.0:1790964084.854610:0:31726:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@0000000027c66538 x1877961927037184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964099 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964084.854617:0:31726:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964084.854618:0:31726:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@0000000027c66538 x1877961927037184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964099 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964084.854624:0:31726:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964084.854625:0:31726:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:1.0:1790964084.854629:0:31726:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964084.854631:0:31726:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: using a timeout of 822 usecs (1 jiffies) 00000100:00000001:1.0:1790964084.854633:0:31726:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 0 is 4295613954 00000100:00000001:1.0:1790964084.854635:0:31726:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request active for cpu 0, keep current deadline 4295613957 00000100:00000001:1.0:1790964084.854637:0:31726:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 1 is 4295613954 00000100:00000001:1.0:1790964084.854638:0:31726:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request active for cpu 1, keep current deadline 4295613957 00000100:00000001:1.0:1790964084.854640:0:31726:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 2 is 4295613954 00000100:00000001:1.0:1790964084.854641:0:31726:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request active for cpu 2, keep current deadline 4295613957 00000100:00000001:1.0:1790964084.854643:0:31726:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS new deadline estimation for cpu 3 is 4295613954 00000100:00000001:1.0:1790964084.854644:0:31726:0:(niobuf.c:692:kick_cpu_latency()) lustre-MDT0001-osp-MDT0000: PM QoS request active for cpu 3, keep current deadline 4295613957 00000100:00000001:1.0:1790964084.854646:0:31726:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1790964084.854648:0:31726:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964084.854650:0:31726:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964084.854652:0:31726:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964084.854656:0:31726:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964084.854658:0:31726:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=5 : 5 : 5) 00000100:00000001:1.0:1790964084.854664:0:31726:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964084.854665:0:31726:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:1.0:1790964084.854667:0:31726:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964084.854668:0:31726:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964084.854695:0:32583:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00000001:3.0:1790964084.855222:0:31730:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:3.0:1790964084.855226:0:31730:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964084.856330:0:32583:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927036928 02000000:00000001:1.0:1790964084.856334:0:32583:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:1.0:1790964084.856337:0:32583:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1790964084.856338:0:32583:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964084.856344:0:32583:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964084.856348:0:32583:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927036928 00000020:00000001:1.0:1790964084.856351:0:32583:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:1.0:1790964084.856353:0:32583:0:(genops.c:804:class_conn2export()) looking for export cookie 0x6a601b0c127d5079 00000020:00000001:1.0:1790964084.856355:0:32583:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:1.0:1790964084.856358:0:32583:0:(lustre_handles.c:148:class_handle2object()) GET export 000000002ab79817 refcount=12 00000020:00000001:1.0:1790964084.856362:0:32583:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446629652579706880 : -114421129844736 : ffff97ef41336800) 00000020:00000001:1.0:1790964084.856364:0:32583:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446629652579706880 : -114421129844736 : ffff97ef41336800) 00000100:00000001:1.0:1790964084.856368:0:32583:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:1.0:1790964084.856374:0:32583:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 0000000025b675ce. 00000100:00000001:1.0:1790964084.856377:0:32583:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1790964084.856379:0:32583:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 0000000025b675ce. 00000020:00000010:1.0:1790964084.856386:0:32583:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b0cb197e. 00000020:00000010:1.0:1790964084.856403:0:32583:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 000000004508d001. 00000020:00000010:1.0:1790964084.856408:0:32583:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 000000002ab25f3d. 00000100:00000040:1.0:1790964084.856420:0:32583:0:(service.c:1432:ptlrpc_at_set_timer()) armed mgs at +6s 00000100:00000001:1.0:1790964084.856424:0:32583:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:1.0:1790964084.856425:0:32583:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:1.0:1790964084.856427:0:32583:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964084.856435:0:32583:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964084.856452:0:32583:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964084.856467:0:32583:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:1.0:1790964084.856469:0:32583:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:1.0:1790964084.856474:0:32583:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00000040:1.0:1790964084.856477:0:32583:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 000000002ab79817 : new rpc_count 1 00000100:00000001:1.0:1790964084.856499:0:32583:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446629656979051600 : -114416730500016 : ffff97f0476c1450) 00000100:00000040:1.0:1790964084.856518:0:32583:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@00000000a30ac6fe x1877961927036928/t0(0) o400->e5c322e7-c837-4fbe-89d7-d887ea2ad81f@0@lo:660/0 lens 224/0 e 0 to 0 dl 1790964095 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964084.856527:0:32583:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:1.0:1790964084.856530:0:32583:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 0000000025b675ce. 00000100:00000001:1.0:1790964084.856531:0:32583:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1790964084.856533:0:32583:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 0000000025b675ce. 00000100:00100000:1.0:1790964084.856537:0:32583:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a30ac6fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+12:31729:x1877961927036928:12345-0@lo:400: 00000100:00000200:1.0:1790964084.856540:0:32583:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877961927036928 00000020:00000001:1.0:1790964084.856543:0:32583:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:1.0:1790964084.856547:0:32583:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:1.0:1790964084.856549:0:32583:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964084.856551:0:32583:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:1.0:1790964084.856553:0:32583:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072667842752 : -1041708864 : ffffffffc1e8c8c0) 00000020:00000001:1.0:1790964084.856556:0:32583:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:1.0:1790964084.856557:0:32583:0:(tgt_handler.c:563:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:1.0:1790964084.856559:0:32583:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:1.0:1790964084.856561:0:32583:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:1.0:1790964084.856564:0:32583:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964084.856566:0:32583:0:(tgt_handler.c:1160:tgt_obd_ping()) Process entered 00000100:00000001:1.0:1790964084.856569:0:32583:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:1.0:1790964084.856571:0:32583:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:1.0:1790964084.856575:0:32583:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 520 at 00000000b7d85fb1. 02000000:00000001:1.0:1790964084.856577:0:32583:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964084.856579:0:32583:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964084.856581:0:32583:0:(tgt_handler.c:1181:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:1.0:1790964084.856584:0:32583:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877961927036928 00010000:00000001:1.0:1790964084.856586:0:32583:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:1.0:1790964084.856590:0:32583:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@00000000a30ac6fe x1877961927036928/t0(0) o400->e5c322e7-c837-4fbe-89d7-d887ea2ad81f@0@lo:660/0 lens 224/224 e 0 to 0 dl 1790964095 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:1.0:1790964084.856597:0:32583:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:1.0:1790964084.856599:0:32583:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1790964084.856602:0:32583:0:(import.c:2195:obd_at_measure()) add 1 to 0000000015821819 time=11 v=5 (1 0 0 0) 00000100:00000001:1.0:1790964084.856606:0:32583:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:1.0:1790964084.856613:0:32583:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000ae02bb19 refcount 17 to 0@lo 00000100:00000001:1.0:1790964084.856615:0:32583:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446629656951528384 : -114416758023232 : ffff97f045c81bc0) 02000000:00000001:1.0:1790964084.856617:0:32583:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:1.0:1790964084.856619:0:32583:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964084.856622:0:32583:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964084.856624:0:32583:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964084.856628:0:32583:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000ed11b0a3. 00000100:00000200:1.0:1790964084.856634:0:32583:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 25, xid 1877961927036928, offset 224 00000400:00000200:1.0:1790964084.856640:0:32583:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964084.856653:0:32583:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964084.856665:0:32583:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 25 MB=0x6abff15901000 00000400:00000200:1.0:1790964084.856670:0:32583:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 19 from 12345-0@lo of length 224/224 into md 0xaf1 [1] + 224 00000400:00000200:1.0:1790964084.856679:0:32583:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964084.856684:0:32583:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:1.0:1790964084.856690:0:32583:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:1.0:1790964084.856694:0:32583:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@00000000397d6266 x1877961927036928/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964100 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964084.856919:0:32595:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:0.0:1790964084.856922:0:32595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927037184 02000000:00000001:0.0:1790964084.856924:0:32595:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:0.0:1790964084.856937:0:32595:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1790964084.856949:0:32595:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964084.856952:0:32595:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:0.0:1790964084.856954:0:32595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927037184 00000020:00000001:0.0:1790964084.856957:0:32595:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:0.0:1790964084.856958:0:32595:0:(genops.c:804:class_conn2export()) looking for export cookie 0x0 00000020:00000001:0.0:1790964084.856959:0:32595:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000001:0.0:1790964084.856961:0:32595:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964084.856963:0:32595:0:(genops.c:806:class_conn2export()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:0.0:1790964084.856966:0:32595:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b1fe457a. 00000020:00000010:0.0:1790964084.856970:0:32595:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 00000000d6290d0b. 00000020:00000010:0.0:1790964084.856973:0:32595:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 00000000bd668636. 00000100:00000001:0.0:1790964084.856977:0:32595:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:0.0:1790964084.856978:0:32595:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:0.0:1790964084.856979:0:32595:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964084.856983:0:32595:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964084.857002:0:32595:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964084.857011:0:32595:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:0.0:1790964084.857012:0:32595:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:0.0:1790964084.857015:0:32595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00000001:0.0:1790964084.857017:0:32595:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446629657930649984 : -114415778901632 : ffff97f080245180) 00000100:00000040:0.0:1790964084.857021:0:32595:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@0000000046ea57fa x1877961927037184/t0(0) o38->@:0/0 lens 520/0 e 0 to 0 dl 1790964104 ref 1 fl New:/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964084.857029:0:32595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046ea57fa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:31726:x1877961927037184:12345-0@lo:38: 00000100:00000200:0.0:1790964084.857032:0:32595:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877961927037184 00000020:00000001:0.0:1790964084.857033:0:32595:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00010000:00000001:0.0:1790964084.857036:0:32595:0:(ldlm_lib.c:1174:target_handle_connect()) Process entered 00000020:00000001:0.0:1790964084.857059:0:32595:0:(genops.c:655:class_str2obd()) Process leaving (rc=0 : 0 : 0) 00010000:00020000:0.0:1790964084.857063:0:32595:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000400:00000010:2.0:1790964084.857497:0:31727:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000dada0f98. 00000100:00000200:2.0:1790964084.857506:0:31727:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1877961927037312, offset 0 00000400:00000200:2.0:1790964084.857512:0:31727:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:2.0:1790964084.857521:0:31727:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:2.0:1790964084.857529:0:31727:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 12 MB=0x6abff15901180 00000400:00000200:2.0:1790964084.857535:0:31727:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index c from 12345-0@lo of length 224/224 into md 0x229 [64] + 1040 00000400:00000200:2.0:1790964084.857559:0:31727:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:2.0:1790964084.857572:0:31727:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:2.0:1790964084.857578:0:31727:0:(events.c:290:request_in_callback()) Process entered 00000100:00000200:2.0:1790964084.857579:0:31727:0:(events.c:300:request_in_callback()) event type 2, status 0, service mdt 00000100:00000010:2.0:1790964084.857583:0:31727:0:(client.c:606:ptlrpc_request_cache_alloc()) slab-alloced 'req': 888 at 000000005183f54b. 00000100:00000040:2.0:1790964084.857586:0:31727:0:(events.c:341:request_in_callback()) incoming req@000000005183f54b x1877961927037312 msgsize 224 00000100:00100000:2.0:1790964084.857590:0:31727:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00000001:2.0:1790964084.857602:0:31727:0:(events.c:377:request_in_callback()) Process leaving 00000400:00000200:2.0:1790964084.857611:0:31727:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000dada0f98 00000400:00000010:2.0:1790964084.857613:0:31727:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000dada0f98. 00000100:00000001:2.0:1790964084.857616:0:31727:0:(events.c:35:request_out_callback()) Process entered 00000100:00000200:2.0:1790964084.857619:0:31727:0:(events.c:40:request_out_callback()) @@@ type 5, status 0 req@000000002fc40658 x1877961927037312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964100 ref 2 fl Rpc:Nr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964084.857629:0:31727:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1790964084.857631:0:31727:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 1 req@000000002fc40658 x1877961927037312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964100 ref 2 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964084.857639:0:31727:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964084.857640:0:31727:0:(events.c:69:request_out_callback()) Process leaving 00000100:00000001:2.0:1790964084.857647:0:31727:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964084.857651:0:31727:0:(niobuf.c:635:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: using a timeout of 11381 usecs (12 jiffies) 00000100:00000001:2.0:1790964084.857654:0:31727:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 0 is 4295613969 00000100:00000001:2.0:1790964084.857660:0:31727:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 0, simply extend its deadline from 4295613957 00000100:00000001:2.0:1790964084.857664:0:31727:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 1 is 4295613969 00000100:00000001:2.0:1790964084.857666:0:31727:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 1, simply extend its deadline from 4295613957 00000100:00000001:2.0:1790964084.857668:0:31727:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 2 is 4295613969 00000100:00000001:2.0:1790964084.857671:0:31727:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 2, simply extend its deadline from 4295613957 00000100:00000001:2.0:1790964084.857673:0:31727:0:(niobuf.c:663:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS new deadline estimation for cpu 3 is 4295613969 00000100:00000001:2.0:1790964084.857675:0:31727:0:(niobuf.c:685:kick_cpu_latency()) lustre-MDT0000-lwp-MDT0000: PM QoS request active for cpu 3, simply extend its deadline from 4295613957 00000100:00000001:2.0:1790964084.857678:0:31727:0:(niobuf.c:1135:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1790964084.857680:0:31727:0:(client.c:1942:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964084.857684:0:31727:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964084.857687:0:31727:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1790964084.858516:0:32583:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@00000000397d6266 x1877961927036928/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964100 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964084.858532:0:32583:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:1.0:1790964084.858543:0:32583:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000ed11b0a3 00000400:00000010:1.0:1790964084.858545:0:32583:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000ed11b0a3. 00000100:00000001:1.0:1790964084.858548:0:32583:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:1.0:1790964084.858550:0:32583:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:1.0:1790964084.858555:0:32583:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964084.858557:0:32583:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000ae02bb19 refcount 16 to 0@lo 00010000:00000001:1.0:1790964084.858559:0:32583:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:1.0:1790964084.858562:0:32583:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964084.858565:0:32583:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:1.0:1790964084.858569:0:32583:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000a30ac6fe x1877961927036928/t0(0) o400->e5c322e7-c837-4fbe-89d7-d887ea2ad81f@0@lo:660/0 lens 224/224 e 0 to 0 dl 1790964095 ref 1 fl Interpret:/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964084.858577:0:32583:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a30ac6fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e5c322e7-c837-4fbe-89d7-d887ea2ad81f+12:31729:x1877961927036928:12345-0@lo:400: Request processed in 2049us (4465us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964084.858599:0:32583:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00000040:1.0:1790964084.858602:0:32583:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002ab79817 : new rpc_count 0 00000100:00000001:1.0:1790964084.858605:0:32583:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:1.0:1790964084.858608:0:32583:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:1.0:1790964084.858614:0:32583:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 000000004508d001. 00000020:00000010:1.0:1790964084.858618:0:32583:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 000000002ab25f3d. 00000020:00000010:1.0:1790964084.858622:0:32583:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b0cb197e. 00000020:00000040:1.0:1790964084.858629:0:32583:0:(genops.c:879:class_export_put()) PUTting export 000000002ab79817 : new refcount 11 02000000:00000001:1.0:1790964084.858634:0:32583:0:(sec.c:2614:sptlrpc_svc_free_rs()) Process entered 02000000:00000010:1.0:1790964084.858637:0:32583:0:(sec_null.c:332:null_free_rs()) kvfree 'rs': 520 at 00000000b7d85fb1. 02000000:00000001:1.0:1790964084.858641:0:32583:0:(sec.c:2627:sptlrpc_svc_free_rs()) Process leaving 00000100:00000001:1.0:1790964084.858643:0:32583:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000200:1.0:1790964084.858649:0:32583:0:(niobuf.c:1191:ptlrpc_register_rqbd()) mgs: registering portal 26 00000400:00000010:1.0:1790964084.858655:0:32583:0:(lib-me.c:74:LNetMEAttach()) slab-alloced 'me': 88 at 00000000583a1491. 00000400:00000010:1.0:1790964084.858661:0:32583:0:(lib-md.c:137:lnet_md_build()) alloc '(lmd)': 152 at 0000000034204322. 00000100:00000001:1.0:1790964084.858687:0:31729:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964084.858691:0:31729:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:1.0:1790964084.858709:0:31729:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:1.0:1790964084.858711:0:31729:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:1.0:1790964084.858713:0:31729:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000d797ccbd. 00000400:00000200:1.0:1790964084.858716:0:31729:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000de759e7f 00000400:00000010:1.0:1790964084.858718:0:31729:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000de759e7f. 00000100:00000001:1.0:1790964084.858720:0:31729:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:1.0:1790964084.858723:0:31729:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@00000000397d6266 x1877961927036928/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964100 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:1.0:1790964084.858730:0:31729:0:(events.c:104:reply_in_callback()) @@@ unlink req@00000000397d6266 x1877961927036928/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964100 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964084.858736:0:31729:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:1.0:1790964084.858737:0:31729:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964084.858739:0:31729:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:1.0:1790964084.858741:0:31729:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:1.0:1790964084.858743:0:31729:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1790964084.858745:0:31729:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964084.858747:0:31729:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1790964084.858761:0:31729:0:(import.c:2195:obd_at_measure()) add 5 to 000000000b342ca4 time=11 v=5 (5 0 0 0) 00000100:00001000:1.0:1790964084.858766:0:31729:0:(import.c:2195:obd_at_measure()) add 1 to 0000000065e52807 time=11 v=5 (1 0 0 0) 00000100:00000001:1.0:1790964084.858768:0:31729:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:1.0:1790964084.858770:0:31729:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:1.0:1790964084.858772:0:31729:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00000001:1.0:1790964084.858774:0:31729:0:(ldlm_request.c:1657:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964084.858777:0:31729:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964084.858780:0:31729:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@00000000397d6266 x1877961927036928/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964084.858786:0:31729:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:1.0:1790964084.858788:0:31729:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:1.0:1790964084.858790:0:31729:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:1.0:1790964084.858793:0:31729:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@00000000397d6266 x1877961927036928/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964100 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964084.858799:0:31729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000397d6266 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e5c322e7-c837-4fbe-89d7-d887ea2ad81f:31729:1877961927036928:0@lo:400: 00000100:00000001:1.0:1790964084.858803:0:31729:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964084.858806:0:31729:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:1.0:1790964084.858807:0:31729:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@00000000397d6266 x1877961927036928/t0(0) o400->MGC192.168.201.147@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1790964100 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964084.858813:0:31729:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:1.0:1790964084.858815:0:31729:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:1.0:1790964084.858818:0:31729:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 00000000992a79f3. 02000000:00000001:1.0:1790964084.858826:0:31729:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:1.0:1790964084.858828:0:31729:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:1.0:1790964084.858829:0:31729:0:(genops.c:1223:class_import_put()) import 00000000f7398c40 refcount=3 obd=MGC192.168.201.147@tcp 00000020:00000001:1.0:1790964084.858832:0:31729:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:1.0:1790964084.858834:0:31729:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at 000000003de5b3a7. 02000000:00000001:1.0:1790964084.858837:0:31729:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:1.0:1790964084.858839:0:31729:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:1.0:1790964084.858840:0:31729:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 00000000397d6266. 00000100:00000001:1.0:1790964084.858843:0:31729:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:1.0:1790964084.858845:0:31729:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964084.858848:0:31729:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964084.858856:0:31729:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:1.0:1790964084.858862:0:31729:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964084.858864:0:31729:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:1.0:1790964084.858866:0:31729:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000020:00000010:1.0:1790964084.858937:0:32591:0:(lprocfs_status.c:1413:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 4608 at 00000000cae7aa8e. 00000100:00000001:1.0:1790964084.858943:0:32591:0:(service.c:2282:ptlrpc_server_handle_req_in()) Process entered 00000100:00100000:1.0:1790964084.858945:0:32591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1877961927037312 02000000:00000001:1.0:1790964084.858946:0:32591:0:(sec.c:2469:sptlrpc_svc_unwrap_request()) Process entered 00000100:00000001:1.0:1790964084.858948:0:32591:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:1.0:1790964084.858949:0:32591:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:1.0:1790964084.858953:0:32591:0:(sec.c:2518:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0) 00000100:00100000:1.0:1790964084.858956:0:32591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1877961927037312 00000020:00000001:1.0:1790964084.858958:0:32591:0:(genops.c:792:class_conn2export()) Process entered 00000020:00000040:1.0:1790964084.858959:0:32591:0:(genops.c:804:class_conn2export()) looking for export cookie 0x6a601b0c127d5159 00000020:00000001:1.0:1790964084.858961:0:32591:0:(lustre_handles.c:130:class_handle2object()) Process entered 00000020:00000040:1.0:1790964084.858963:0:32591:0:(lustre_handles.c:148:class_handle2object()) GET export 00000000e69d572d refcount=5 00000020:00000001:1.0:1790964084.858965:0:32591:0:(lustre_handles.c:155:class_handle2object()) Process leaving (rc=18446629657920555008 : -114415788996608 : ffff97f07f8a4800) 00000020:00000001:1.0:1790964084.858967:0:32591:0:(genops.c:806:class_conn2export()) Process leaving (rc=18446629657920555008 : -114415788996608 : ffff97f07f8a4800) 00000100:00000001:1.0:1790964084.858970:0:32591:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:1.0:1790964084.858972:0:32591:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 0000000025b675ce. 00000100:00000001:1.0:1790964084.858974:0:32591:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1790964084.858976:0:32591:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 0000000025b675ce. 00000020:00000010:1.0:1790964084.858981:0:32591:0:(lu_object.c:1758:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000992a79f3. 00000020:00000010:1.0:1790964084.858983:0:32591:0:(lu_ucred.c:27:lu_ucred_key_init()) kmalloced '(value)': 128 at 00000000e0a90b75. 00000020:00000010:1.0:1790964084.858986:0:32591:0:(tgt_main.c:758:tgt_ses_key_init()) slab-alloced 'session': 200 at 000000002ab25f3d. 00000100:00000040:1.0:1790964084.858992:0:32591:0:(service.c:1432:ptlrpc_at_set_timer()) armed mdt at +6s 00000100:00000001:1.0:1790964084.858994:0:32591:0:(service.c:2003:ptlrpc_server_request_add()) Process entered 00000100:00000001:1.0:1790964084.858995:0:32591:0:(service.c:1919:ptlrpc_server_hpreq_init()) Process entered 00000100:00000001:1.0:1790964084.858997:0:32591:0:(service.c:1949:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964084.859004:0:32591:0:(nrs.c:885:ptlrpc_nrs_hpreq_add_nolock()) Process entered 00000100:00000001:1.0:1790964084.859006:0:32591:0:(nrs.c:893:ptlrpc_nrs_hpreq_add_nolock()) Process leaving 00000100:00000001:1.0:1790964084.859007:0:32591:0:(service.c:2101:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964084.859018:0:32591:0:(service.c:2445:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:1.0:1790964084.859025:0:32591:0:(service.c:2479:ptlrpc_server_handle_request()) Process entered 00000100:00000001:1.0:1790964084.859027:0:32591:0:(service.c:2223:ptlrpc_server_request_get()) Process entered 00000100:00100000:1.0:1790964084.859030:0:32591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00000040:1.0:1790964084.859041:0:32591:0:(service.c:2255:ptlrpc_server_request_get()) RPC GETting export 00000000e69d572d : new rpc_count 1 00000100:00000001:1.0:1790964084.859043:0:32591:0:(service.c:2257:ptlrpc_server_request_get()) Process leaving (rc=18446629657336981120 : -114416372570496 : ffff97f05cc1a680) 00000100:00000040:1.0:1790964084.859047:0:32591:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret req@000000005183f54b x1877961927037312/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:660/0 lens 224/0 e 0 to 0 dl 1790964095 ref 1 fl New:H/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964084.859054:0:32591:0:(service.c:1268:ptlrpc_update_export_timer()) Process entered 00000020:00000010:1.0:1790964084.859056:0:32591:0:(genops.c:1055:obd_export_timed_init()) kmalloced '(*data)': 48 at 0000000025b675ce. 00000100:00000001:1.0:1790964084.859058:0:32591:0:(service.c:1290:ptlrpc_update_export_timer()) Process leaving via err (rc=0 : 0 : 0x0) 00000020:00000010:1.0:1790964084.859059:0:32591:0:(genops.c:1063:obd_export_timed_fini()) kfreed '*data': 48 at 0000000025b675ce. 00000100:00100000:1.0:1790964084.859063:0:32591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005183f54b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:31727:x1877961927037312:12345-0@lo:400: 00000100:00000200:1.0:1790964084.859066:0:32591:0:(service.c:2563:ptlrpc_server_handle_request()) got req 1877961927037312 00000020:00000001:1.0:1790964084.859068:0:32591:0:(tgt_handler.c:764:tgt_request_handle()) Process entered 00000020:00000001:1.0:1790964084.859071:0:32591:0:(tgt_handler.c:683:process_req_last_xid()) Process entered 00000020:00000001:1.0:1790964084.859073:0:32591:0:(tgt_handler.c:748:process_req_last_xid()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964084.859075:0:32591:0:(tgt_handler.c:620:tgt_handler_find_check()) Process entered 00000020:00000001:1.0:1790964084.859076:0:32591:0:(tgt_handler.c:657:tgt_handler_find_check()) Process leaving (rc=18446744072659955392 : -1049596224 : ffffffffc1706ec0) 00000020:00000001:1.0:1790964084.859079:0:32591:0:(tgt_handler.c:550:tgt_handle_recovery()) Process entered 00000020:00000001:1.0:1790964084.859082:0:32591:0:(tgt_handler.c:607:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1) 00000020:00000001:1.0:1790964084.859083:0:32591:0:(tgt_handler.c:375:tgt_handle_request0()) Process entered 00000020:00000001:1.0:1790964084.859085:0:32591:0:(tgt_handler.c:296:tgt_request_preprocess()) Process entered 00000020:00000001:1.0:1790964084.859087:0:32591:0:(tgt_handler.c:359:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964084.859089:0:32591:0:(tgt_handler.c:1160:tgt_obd_ping()) Process entered 00000100:00000001:1.0:1790964084.859092:0:32591:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:1.0:1790964084.859094:0:32591:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 02000000:00000010:1.0:1790964084.859097:0:32591:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 520 at 00000000b7d85fb1. 02000000:00000001:1.0:1790964084.859099:0:32591:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964084.859101:0:32591:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964084.859103:0:32591:0:(tgt_handler.c:1181:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0) 00010000:00000040:1.0:1790964084.859106:0:32591:0:(ldlm_lib.c:3333:target_committed_to_req()) last_committed 0, transno 0, xid 1877961927037312 00010000:00000001:1.0:1790964084.859108:0:32591:0:(ldlm_lib.c:3402:target_send_reply()) Process entered 00010000:00000200:1.0:1790964084.859112:0:32591:0:(ldlm_lib.c:3390:target_send_reply_msg()) @@@ sending reply req@000000005183f54b x1877961927037312/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:660/0 lens 224/224 e 0 to 0 dl 1790964095 ref 1 fl Interpret:H/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:1.0:1790964084.859119:0:32591:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:1.0:1790964084.859121:0:32591:0:(ldlm_lib.c:3366:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:1.0:1790964084.859128:0:32591:0:(import.c:2195:obd_at_measure()) add 1 to 000000003d86d497 time=5 v=5 (1 0 0 0) 00000100:00000001:1.0:1790964084.859132:0:32591:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:1.0:1790964084.859134:0:32591:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000ae02bb19 refcount 17 to 0@lo 00000100:00000001:1.0:1790964084.859136:0:32591:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446629656951528384 : -114416758023232 : ffff97f045c81bc0) 02000000:00000001:1.0:1790964084.859139:0:32591:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:1.0:1790964084.859141:0:32591:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:1.0:1790964084.859143:0:32591:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:1.0:1790964084.859145:0:32591:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:1.0:1790964084.859147:0:32591:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000de759e7f. 00000100:00000200:1.0:1790964084.859151:0:32591:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1877961927037312, offset 224 00000400:00000200:1.0:1790964084.859154:0:32591:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:1.0:1790964084.859164:0:32591:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:1.0:1790964084.859170:0:32591:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 10 MB=0x6abff15901180 00000400:00000200:1.0:1790964084.859175:0:32591:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index a from 12345-0@lo of length 224/224 into md 0xaed [1] + 224 00000400:00000200:1.0:1790964084.859182:0:32591:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:1.0:1790964084.859185:0:32591:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:1.0:1790964084.859189:0:32591:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:1.0:1790964084.859193:0:32591:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@000000002fc40658 x1877961927037312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964100 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:1.0:1790964084.859215:0:32591:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=224 replen=224 req@000000002fc40658 x1877961927037312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964100 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:1.0:1790964084.859222:0:32591:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:1.0:1790964084.859226:0:32591:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000de759e7f 00000400:00000010:1.0:1790964084.859228:0:32591:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000de759e7f. 00000100:00000001:1.0:1790964084.859230:0:32591:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:1.0:1790964084.859231:0:32591:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:1.0:1790964084.859233:0:32591:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:1.0:1790964084.859235:0:32591:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000ae02bb19 refcount 16 to 0@lo 00010000:00000001:1.0:1790964084.859238:0:32591:0:(ldlm_lib.c:3414:target_send_reply()) Process leaving 00000020:00000001:1.0:1790964084.859239:0:32591:0:(tgt_handler.c:497:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:1.0:1790964084.859240:0:32591:0:(tgt_handler.c:905:tgt_request_handle()) Process leaving 00000100:00000040:1.0:1790964084.859243:0:32591:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000005183f54b x1877961927037312/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:660/0 lens 224/224 e 0 to 0 dl 1790964095 ref 1 fl Interpret:H/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1790964084.859249:0:32591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005183f54b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:31727:x1877961927037312:12345-0@lo:400: Request processed in 196us (1662us total) trans 0 rc 0/0 00000100:00100000:1.0:1790964084.859261:0:32591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00000040:1.0:1790964084.859263:0:32591:0:(service.c:1113:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e69d572d : new rpc_count 0 00000100:00000001:1.0:1790964084.859265:0:32591:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:1.0:1790964084.859266:0:32591:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:1.0:1790964084.859269:0:32591:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 00000000e0a90b75. 00000020:00000010:1.0:1790964084.859272:0:32591:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 000000002ab25f3d. 00000020:00000010:1.0:1790964084.859274:0:32591:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000992a79f3. 00000020:00000040:1.0:1790964084.859278:0:32591:0:(genops.c:879:class_export_put()) PUTting export 00000000e69d572d : new refcount 4 00000100:00000001:1.0:1790964084.859281:0:32591:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964084.859783:0:31727:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964084.859787:0:31727:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=11 : 11 : b) 00000100:00000001:2.0:1790964084.859790:0:31727:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964084.859791:0:31727:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:2.0:1790964084.859796:0:31727:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:2.0:1790964084.859798:0:31727:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:2.0:1790964084.859799:0:31727:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 000000002bce9eb1. 00000400:00000200:2.0:1790964084.859803:0:31727:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000b18255f0 00000400:00000010:2.0:1790964084.859805:0:31727:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000b18255f0. 00000100:00000001:2.0:1790964084.859807:0:31727:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:2.0:1790964084.859811:0:31727:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@000000002fc40658 x1877961927037312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964100 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:2.0:1790964084.859819:0:31727:0:(events.c:104:reply_in_callback()) @@@ unlink req@000000002fc40658 x1877961927037312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964100 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964084.859824:0:31727:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:2.0:1790964084.859826:0:31727:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964084.859827:0:31727:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:2.0:1790964084.859830:0:31727:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:2.0:1790964084.859831:0:31727:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:2.0:1790964084.859833:0:31727:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:2.0:1790964084.859834:0:31727:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:2.0:1790964084.859841:0:31727:0:(import.c:2195:obd_at_measure()) add 5 to 000000005f041a34 time=5 v=5 (5 0 0 0) 00000100:00001000:2.0:1790964084.859844:0:31727:0:(import.c:2195:obd_at_measure()) add 1 to 0000000098fc34f8 time=5 v=5 (1 0 0 0) 00000100:00000001:2.0:1790964084.859847:0:31727:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:2.0:1790964084.859848:0:31727:0:(client.c:1533:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964084.859849:0:31727:0:(ldlm_request.c:1653:ldlm_cli_update_pool()) Process entered 00010000:00080000:2.0:1790964084.859853:0:31727:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000002fc40658 x1877961927037312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00000001:2.0:1790964084.859858:0:31727:0:(ldlm_request.c:1672:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964084.859861:0:31727:0:(client.c:3110:ptlrpc_free_committed()) Process entered 00000100:00000040:2.0:1790964084.859862:0:31727:0:(client.c:3122:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: skip recheck: last_committed 0 00000100:00000001:2.0:1790964084.859864:0:31727:0:(client.c:3123:ptlrpc_free_committed()) Process leaving 00000100:00000001:2.0:1790964084.859866:0:31727:0:(client.c:1798:after_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:2.0:1790964084.859868:0:31727:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@000000002fc40658 x1877961927037312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964100 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964084.859886:0:31727:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0) 00000100:00000001:2.0:1790964084.859888:0:31727:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:2.0:1790964084.859890:0:31727:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000040:2.0:1790964084.859892:0:31727:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@000000002fc40658 x1877961927037312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964100 ref 1 fl Interpret:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1790964084.859898:0:31727:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002fc40658 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:31727:1877961927037312:0@lo:400: 00000100:00000001:2.0:1790964084.859901:0:31727:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964084.859903:0:31727:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:2.0:1790964084.859905:0:31727:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@000000002fc40658 x1877961927037312/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1790964100 ref 1 fl Complete:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:2.0:1790964084.859910:0:31727:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:2.0:1790964084.859911:0:31727:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:2.0:1790964084.859913:0:31727:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 0000000097d312e9. 02000000:00000001:2.0:1790964084.859916:0:31727:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:2.0:1790964084.859917:0:31727:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:2.0:1790964084.859919:0:31727:0:(genops.c:1223:class_import_put()) import 000000007c9fe86f refcount=2 obd=lustre-MDT0000-lwp-MDT0000 00000020:00000001:2.0:1790964084.859920:0:31727:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:2.0:1790964084.859922:0:31727:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 256 at 0000000064b124cf. 02000000:00000001:2.0:1790964084.859924:0:31727:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:2.0:1790964084.859926:0:31727:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:2.0:1790964084.859927:0:31727:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 000000002fc40658. 00000100:00000001:2.0:1790964084.859929:0:31727:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:2.0:1790964084.859930:0:31727:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964084.859932:0:31727:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:2.0:1790964084.859936:0:31727:0:(client.c:2640:ptlrpc_set_next_timeout()) Process entered 00000100:00000001:2.0:1790964084.859937:0:31727:0:(client.c:2668:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:2.0:1790964084.859938:0:31727:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:2.0:1790964084.859940:0:31727:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:3.0:1790964084.870621:0:12040:0:(connection.c:75:cpu_latency_work()) work item of 00000000ae8cb54c (cpu 3) has reached its deadline 4295613969, at 4295613970 00000100:00000010:3.0:1790964084.870637:0:12040:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000a7f6c55e. 00000100:00000040:2.0:1790964084.871324:0:31384:0:(connection.c:75:cpu_latency_work()) work item of 000000002f5f8e48 (cpu 2) has reached its deadline 4295613969, at 4295613970 00000100:00000010:2.0:1790964084.871332:0:31384:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 00000000910ccaab. 00000100:00000040:1.0:1790964084.872084:0:3119:0:(connection.c:75:cpu_latency_work()) work item of 000000002146c102 (cpu 1) has reached its deadline 4295613969, at 4295613971 00000100:00000010:1.0:1790964084.872093:0:3119:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 0000000090e506c1. 00010000:00000001:0.0:1790964084.892601:0:32595:0:(ldlm_lib.c:1191:target_handle_connect()) Process leaving via out (rc=18446744073709551597 : -19 : 0xffffffffffffffed) 00010000:00000001:0.0:1790964084.892631:0:32595:0:(ldlm_lib.c:1741:target_handle_connect()) Process leaving (rc=18446744073709551597 : -19 : ffffffffffffffed) 00000100:00000001:0.0:1790964084.892634:0:32595:0:(niobuf.c:816:ptlrpc_send_error()) Process entered 00000100:00000001:0.0:1790964084.892638:0:32595:0:(pack_generic.c:297:lustre_pack_reply_v2()) Process entered 02000000:00000001:0.0:1790964084.892641:0:32595:0:(sec.c:2540:sptlrpc_svc_alloc_rs()) Process entered 00000100:00000040:0.0:1790964084.892662:0:127:0:(connection.c:75:cpu_latency_work()) work item of 0000000021367367 (cpu 0) has reached its deadline 4295613969, at 4295613990 00000100:00000010:0.0:1790964084.892673:0:127:0:(connection.c:94:cpu_latency_work()) kfreed 'pm_qos_req_done': 72 at 000000007d2d5880. 02000000:00000010:0.0:1790964084.892686:0:32595:0:(sec_null.c:305:null_alloc_rs()) kmalloced '(rs)': 520 at 000000005593880e. 02000000:00000001:0.0:1790964084.892688:0:32595:0:(sec.c:2577:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964084.892691:0:32595:0:(pack_generic.c:332:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:0.0:1790964084.893414:0:32595:0:(ldlm_lib.c:3345:target_pack_pool_reply()) Process entered 00010000:00000001:0.0:1790964084.893419:0:32595:0:(ldlm_lib.c:3355:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1790964084.893424:0:32595:0:(niobuf.c:600:ptlrpc_at_set_reply()) No early reply support: flags=0x0 req_flags=0x200 magic=bd00bd3/bd00bd3 len=224 00000100:00000001:0.0:1790964084.893428:0:32595:0:(connection.c:105:ptlrpc_connection_get()) Process entered 00000100:00000001:0.0:1790964084.893431:0:32595:0:(connection.c:157:ptlrpc_connection_addref()) Process entered 00000100:00000040:0.0:1790964084.893435:0:32595:0:(connection.c:162:ptlrpc_connection_addref()) conn=00000000ae02bb19 refcount 17 to 0@lo 00000100:00000001:0.0:1790964084.893438:0:32595:0:(connection.c:164:ptlrpc_connection_addref()) Process leaving (rc=18446629656951528384 : -114416758023232 : ffff97f045c81bc0) 00000100:00000001:0.0:1790964084.893440:0:32595:0:(connection.c:111:ptlrpc_connection_get()) Process leaving via out (rc=18446629656951528384 : -114416758023232 : 0xffff97f045c81bc0) 00000100:00000040:0.0:1790964084.893443:0:32595:0:(connection.c:150:ptlrpc_connection_get()) conn=00000000ae02bb19 refcount 17 to 0@lo 02000000:00000001:0.0:1790964084.893445:0:32595:0:(sec.c:2591:sptlrpc_svc_wrap_reply()) Process entered 02000000:00000001:0.0:1790964084.893447:0:32595:0:(sec.c:2602:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964084.893450:0:32595:0:(niobuf.c:69:ptl_send_buf()) Process entered 00000100:00000040:0.0:1790964084.893452:0:32595:0:(niobuf.c:72:ptl_send_buf()) peer_id 12345-0@lo 00000400:00000010:0.0:1790964084.893458:0:32595:0:(lib-md.c:131:lnet_md_build()) slab-alloced 'lmd': 136 at 00000000e334cc40. 00000100:00000200:0.0:1790964084.893465:0:32595:0:(niobuf.c:94:ptl_send_buf()) Sending 224 bytes to portal 4, xid 1877961927037184, offset 0 00000400:00000200:0.0:1790964084.893472:0:32595:0:(lib-move.c:5150:LNetPut()) LNetPut -> 12345-0@lo 00000400:00000200:0.0:1790964084.893527:0:32595:0:(lib-move.c:4645:lnet_parse()) TRACE: 0@lo(0@lo) <- 0@lo : PUT - for me 00000400:00000200:0.0:1790964084.893538:0:32595:0:(lib-ptl.c:582:lnet_ptl_match_md()) Request from 12345-0@lo of length 224 into portal 4 MB=0x6abff15901100 00000400:00000200:0.0:1790964084.893544:0:32595:0:(lib-ptl.c:208:lnet_try_match_md()) Incoming put index 4 from 12345-0@lo of length 224/224 into md 0xb01 [1] + 0 00000400:00000200:0.0:1790964084.893553:0:32595:0:(lib-msg.c:1121:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0 00000400:00000200:0.0:1790964084.893557:0:32595:0:(lib-msg.c:895:lnet_health_check()) health check: 0@lo->0@lo: PUT: OK 00000100:00000001:0.0:1790964084.893563:0:32595:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:0.0:1790964084.893569:0:32595:0:(events.c:82:reply_in_callback()) @@@ type 2, status 0 req@0000000027c66538 x1877961927037184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964099 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000040:0.0:1790964084.893591:0:32595:0:(events.c:151:reply_in_callback()) @@@ reply in flags=200 mlen=224 offset=0 replen=544 req@0000000027c66538 x1877961927037184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964099 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964084.893606:0:32595:0:(events.c:165:reply_in_callback()) Process leaving 00000400:00000200:0.0:1790964084.893616:0:32595:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000e334cc40 00000400:00000010:0.0:1790964084.893618:0:32595:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000e334cc40. 00000100:00000001:0.0:1790964084.893621:0:32595:0:(events.c:390:reply_out_callback()) Process entered 00000100:00000001:0.0:1790964084.893623:0:32595:0:(events.c:402:reply_out_callback()) Process leaving 00000100:00000001:0.0:1790964084.893628:0:32595:0:(niobuf.c:111:ptl_send_buf()) Process leaving (rc=0 : 0 : 0) 00000100:00000040:0.0:1790964084.893631:0:32595:0:(lustre_net.h:1977:ptlrpc_connection_put()) PUT conn=00000000ae02bb19 refcount 16 to 0@lo 00000100:00000001:0.0:1790964084.893634:0:32595:0:(niobuf.c:837:ptlrpc_send_error()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:0.0:1790964084.893637:0:32595:0:(tgt_handler.c:789:tgt_request_handle()) Process leaving via out (rc=0 : 0 : 0x0) 00000100:00000040:0.0:1790964084.893642:0:32595:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@0000000046ea57fa x1877961927037184/t0(0) o38->@:0/0 lens 520/224 e 0 to 0 dl 1790964104 ref 1 fl Interpret:/200/0 rc -19/-19 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964084.893650:0:32595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046ea57fa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:31726:x1877961927037184:12345-0@lo:38: Request processed in 36620us (39058us total) trans 0 rc -19/-19 00000100:00100000:0.0:1790964084.893661:0:32595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00000001:0.0:1790964084.893664:0:32595:0:(service.c:1955:ptlrpc_server_hpreq_fini()) Process entered 00000100:00000001:0.0:1790964084.893666:0:32595:0:(service.c:1966:ptlrpc_server_hpreq_fini()) Process leaving 00000020:00000010:0.0:1790964084.893673:0:32595:0:(lu_ucred.c:27:lu_ucred_key_fini()) kfreed 'info': 128 at 00000000d6290d0b. 00000020:00000010:0.0:1790964084.893677:0:32595:0:(tgt_main.c:770:tgt_ses_key_fini()) slab-freed '(session)': 200 at 00000000bd668636. 00000020:00000010:0.0:1790964084.893681:0:32595:0:(lu_object.c:1686:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b1fe457a. 00000100:00000001:0.0:1790964084.893685:0:32595:0:(service.c:2635:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964084.893721:0:31726:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964084.893725:0:31726:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000400:00000001:0.0:1790964084.893733:0:31726:0:(lib-msg.c:22:lnet_build_unlink_event()) Process entered 00000400:00000001:0.0:1790964084.893735:0:31726:0:(lib-msg.c:31:lnet_build_unlink_event()) Process leaving 00000400:00000010:0.0:1790964084.893737:0:31726:0:(lib-me.c:117:lnet_me_unlink()) slab-freed 'me': 88 at 00000000809aaa59. 00000400:00000200:0.0:1790964084.893741:0:31726:0:(lib-md.c:46:lnet_md_unlink()) Unlinking md 00000000077be555 00000400:00000010:0.0:1790964084.893743:0:31726:0:(lib-lnet.h:283:lnet_md_free()) slab-freed 'md': 136 at 00000000077be555. 00000100:00000001:0.0:1790964084.893745:0:31726:0:(events.c:80:reply_in_callback()) Process entered 00000100:00000200:0.0:1790964084.893749:0:31726:0:(events.c:82:reply_in_callback()) @@@ type 6, status 0 req@0000000027c66538 x1877961927037184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964099 ref 1 fl Rpc:RNQ/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000200:0.0:1790964084.893757:0:31726:0:(events.c:104:reply_in_callback()) @@@ unlink req@0000000027c66538 x1877961927037184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 1790964099 ref 1 fl Rpc:RNQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964084.893769:0:31726:0:(events.c:165:reply_in_callback()) Process leaving 00000100:00000001:0.0:1790964084.893771:0:31726:0:(client.c:3002:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964084.893773:0:31726:0:(client.c:1593:after_reply()) Process entered 02000000:00000001:0.0:1790964084.893776:0:31726:0:(sec.c:1125:do_cli_unwrap_reply()) Process entered 00000100:00000001:0.0:1790964084.893778:0:31726:0:(pack_generic.c:606:__lustre_unpack_msg()) Process entered 00000100:00000001:0.0:1790964084.893780:0:31726:0:(pack_generic.c:624:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0) 02000000:00000001:0.0:1790964084.893782:0:31726:0:(sec.c:1181:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0) 00000100:00001000:0.0:1790964084.893792:0:31726:0:(import.c:2195:obd_at_measure()) add 0 to 00000000bc1788d5 time=1790964084 v=5 (0 0 0 0) 00000100:00001000:0.0:1790964084.893795:0:31726:0:(import.c:2195:obd_at_measure()) add 1 to 00000000de9532a1 time=10 v=10 (10 0 0 0) 00000100:00000001:0.0:1790964084.893798:0:31726:0:(client.c:1495:ptlrpc_check_status()) Process entered 00000100:00000001:0.0:1790964084.893800:0:31726:0:(client.c:1506:ptlrpc_check_status()) Process leaving (rc=18446744073709551597 : -19 : ffffffffffffffed) 00000100:00000001:0.0:1790964084.893802:0:31726:0:(client.c:1712:after_reply()) Process leaving (rc=18446744073709551597 : -19 : ffffffffffffffed) 00000100:00000040:0.0:1790964084.893807:0:31726:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret req@0000000027c66538 x1877961927037184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/224 e 0 to 0 dl 1790964099 ref 1 fl Rpc:RNQU/200/0 rc -19/-19 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964084.893813:0:31726:0:(client.c:2355:ptlrpc_check_set()) Process leaving via interpret (rc=18446744073709551597 : -19 : 0xffffffffffffffed) 00000100:00000001:0.0:1790964084.893816:0:31726:0:(niobuf.c:473:ptlrpc_unregister_bulk()) Process entered 00000100:00000001:0.0:1790964084.893817:0:31726:0:(niobuf.c:487:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964084.893819:0:31726:0:(import.c:1101:ptlrpc_connect_interpret()) Process entered 00000100:00000001:0.0:1790964084.893822:0:31726:0:(import.c:1136:ptlrpc_connect_interpret()) Process leaving via out (rc=18446744073709551597 : -19 : 0xffffffffffffffed) 00000100:00080000:0.0:1790964084.893825:0:31726:0:(import.c:65:import_set_state_nolock()) 00000000d0c8ccf1 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1790964084.893839:0:31726:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00000001:0.0:1790964084.893842:0:31726:0:(import.c:1561:ptlrpc_connect_interpret()) Process leaving (rc=18446744073709551597 : -19 : ffffffffffffffed) 00000100:00000040:0.0:1790964084.893844:0:31726:0:(lustre_net.h:2417:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete req@0000000027c66538 x1877961927037184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/224 e 0 to 0 dl 1790964099 ref 1 fl Interpret:RNQU/200/0 rc -19/-19 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1790964084.893852:0:31726:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000027c66538 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:31726:1877961927037184:0@lo:38: 00000100:00000001:0.0:1790964084.893856:0:31726:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964084.893859:0:31726:0:(client.c:2868:__ptlrpc_req_put()) Process entered 00000100:00000040:0.0:1790964084.893861:0:31726:0:(client.c:2876:__ptlrpc_req_put()) @@@ refcount now 0 req@0000000027c66538 x1877961927037184/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/224 e 0 to 0 dl 1790964099 ref 1 fl Complete:RNQU/200/0 rc -19/-19 job:'' uid:0 gid:0 projid:4294967295 00000100:00000001:0.0:1790964084.893867:0:31726:0:(client.c:2794:__ptlrpc_free_req()) Process entered 02000000:00000001:0.0:1790964084.893885:0:31726:0:(sec.c:1880:sptlrpc_cli_free_repbuf()) Process entered 02000000:00000010:0.0:1790964084.893887:0:31726:0:(sec_null.c:203:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000ce48b43d. 02000000:00000001:0.0:1790964084.893892:0:31726:0:(sec.c:1896:sptlrpc_cli_free_repbuf()) Process leaving 00000020:00000001:0.0:1790964084.893894:0:31726:0:(genops.c:1217:class_import_put()) Process entered 00000020:00000040:0.0:1790964084.893895:0:31726:0:(genops.c:1223:class_import_put()) import 00000000d0c8ccf1 refcount=3 obd=lustre-MDT0001-osp-MDT0000 00000020:00000001:0.0:1790964084.893897:0:31726:0:(genops.c:1230:class_import_put()) Process leaving 02000000:00000010:0.0:1790964084.893899:0:31726:0:(sec_null.c:173:null_free_reqbuf()) kvfree 'req->rq_reqbuf': 1024 at 00000000c73348d2. 02000000:00000001:0.0:1790964084.893902:0:31726:0:(sec.c:473:sptlrpc_req_put_ctx()) Process entered 02000000:00000001:0.0:1790964084.893903:0:31726:0:(sec.c:490:sptlrpc_req_put_ctx()) Process leaving 00000100:00000010:0.0:1790964084.893905:0:31726:0:(client.c:612:ptlrpc_request_cache_free()) slab-freed '(req)': 888 at 0000000027c66538. 00000100:00000001:0.0:1790964084.893908:0:31726:0:(client.c:2850:__ptlrpc_free_req()) Process leaving 00000100:00000001:0.0:1790964084.893909:0:31726:0:(client.c:2909:__ptlrpc_req_put()) Process leaving (rc=1 : 1 : 1) 00000100:00000001:0.0:1790964084.893911:0:31726:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964084.893913:0:31726:0:(ptlrpcd.c:252:ptlrpcd_check()) Process entered 00000100:00000001:0.0:1790964084.893914:0:31726:0:(client.c:1991:ptlrpc_check_set()) Process entered 00000100:00000001:0.0:1790964084.893915:0:31726:0:(client.c:2466:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0) 00000100:00000001:0.0:1790964084.893917:0:31726:0:(ptlrpcd.c:351:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0) 00080000:00000001:3.0:1790964085.068989:0:33034:0:(osd_handler.c:571:osd_statfs()) Process entered 00080000:00000001:3.0:1790964085.069007:0:33034:0:(osd_handler.c:585:osd_statfs()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964085.069012:0:33034:0:(tgt_mount.c:2308:server_show_options()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964085.173573:0:31384:0:(ldlm_pool.c:317:ldlm_srv_pool_recalc()) Process entered 00010000:00000001:2.0:1790964085.173581:0:31384:0:(ldlm_pool.c:349:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00010000:00000001:2.0:1790964085.173600:0:31384:0:(ldlm_pool.c:457:ldlm_cli_pool_recalc()) Process entered 00010000:00000001:2.0:1790964085.173601:0:31384:0:(ldlm_pool.c:461:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0) 00000020:00000001:3.0:1790964085.173692:0:32579:0:(genops.c:1895:obd_stale_export_get()) Process entered 00000020:00000001:3.0:1790964085.173696:0:32579:0:(genops.c:1909:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0) 00010000:00010000:3.0:1790964085.173698:0:32579:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 3379 lines, 3379 kept, 0 dropped, 0 bad.